Apr 19 13:50:01 user devstack@n-api.service[61610]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 19 13:50:01 user devstack@n-api.service[61610]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 19 13:50:01 2023] *** Apr 19 13:50:01 user devstack@n-api.service[61610]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 19 13:50:01 user devstack@n-api.service[61610]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 19 13:50:01 user devstack@n-api.service[61610]: nodename: user Apr 19 13:50:01 user devstack@n-api.service[61610]: machine: x86_64 Apr 19 13:50:01 user devstack@n-api.service[61610]: clock source: unix Apr 19 13:50:01 user devstack@n-api.service[61610]: pcre jit disabled Apr 19 13:50:01 user devstack@n-api.service[61610]: detected number of CPU cores: 12 Apr 19 13:50:01 user devstack@n-api.service[61610]: current working directory: / Apr 19 13:50:01 user devstack@n-api.service[61610]: detected binary path: /usr/bin/uwsgi-core Apr 19 13:50:01 user devstack@n-api.service[61610]: your processes number limit is 63637 Apr 19 13:50:01 user devstack@n-api.service[61610]: your memory page size is 4096 bytes Apr 19 13:50:01 user devstack@n-api.service[61610]: detected max file descriptor number: 2048 Apr 19 13:50:01 user devstack@n-api.service[61610]: lock engine: pthread robust mutexes Apr 19 13:50:01 user devstack@n-api.service[61610]: thunder lock: enabled Apr 19 13:50:01 user devstack@n-api.service[61610]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 19 13:50:01 user devstack@n-api.service[61610]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 19 13:50:01 user devstack@n-api.service[61610]: Python main interpreter initialized at 0x563701f26990 Apr 19 13:50:01 user devstack@n-api.service[61610]: python threads support enabled Apr 19 13:50:01 user devstack@n-api.service[61610]: your server socket listen backlog is limited to 100 connections Apr 19 13:50:01 user devstack@n-api.service[61610]: your mercy for graceful operations on workers is 90 seconds Apr 19 13:50:01 user devstack@n-api.service[61610]: mapped 537436 bytes (524 KB) for 3 cores Apr 19 13:50:01 user devstack@n-api.service[61610]: *** Operational MODE: preforking *** Apr 19 13:50:01 user devstack@n-api.service[61610]: *** uWSGI is running in multiple interpreter mode *** Apr 19 13:50:01 user devstack@n-api.service[61610]: spawned uWSGI master process (pid: 61610) Apr 19 13:50:01 user devstack@n-api.service[61610]: spawned uWSGI worker 1 (pid: 61611, cores: 1) Apr 19 13:50:01 user devstack@n-api.service[61610]: spawned uWSGI worker 2 (pid: 61612, cores: 1) Apr 19 13:50:01 user devstack@n-api.service[61610]: spawned uWSGI worker 3 (pid: 61613, cores: 1) Apr 19 13:50:01 user devstack@n-api.service[61610]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 19 13:50:01 user devstack@n-api.service[61611]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 13:50:02 user devstack@n-api.service[61613]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 13:50:02 user devstack@n-api.service[61612]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 13:50:05 user devstack@n-api.service[61611]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 13:50:05 user devstack@n-api.service[61611]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 13:50:05 user devstack@n-api.service[61611]: and ``live_migration_inbound_addr`` respectively. Apr 19 13:50:05 user devstack@n-api.service[61611]: ). Its value may be silently ignored in the future. Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 13:50:05 user devstack@n-api.service[61612]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 13:50:05 user devstack@n-api.service[61612]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 13:50:05 user devstack@n-api.service[61612]: and ``live_migration_inbound_addr`` respectively. Apr 19 13:50:05 user devstack@n-api.service[61612]: ). Its value may be silently ignored in the future. Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 13:50:05 user devstack@n-api.service[61613]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 13:50:05 user devstack@n-api.service[61613]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 13:50:05 user devstack@n-api.service[61613]: and ``live_migration_inbound_addr`` respectively. Apr 19 13:50:05 user devstack@n-api.service[61613]: ). Its value may be silently ignored in the future. Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61611) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61612) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61613) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 13:50:05 user devstack@n-api.service[61611]: INFO dbcounter [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Registered counter for database nova_api Apr 19 13:50:05 user devstack@n-api.service[61613]: INFO dbcounter [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Registered counter for database nova_api Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG oslo_db.sqlalchemy.engines [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61611) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writer thread running {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG oslo_db.sqlalchemy.engines [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61613) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61612]: INFO dbcounter [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Registered counter for database nova_api Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writer thread running {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG nova.context [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2620343c-c8d1-48e6-ac23-7775ee8493ea(cell1) {{(pid=61611) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG oslo_db.sqlalchemy.engines [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61612) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:50:05 user devstack@n-api.service[61611]: INFO dbcounter [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Registered counter for database nova_cell0 Apr 19 13:50:05 user devstack@n-api.service[61611]: INFO dbcounter [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Registered counter for database nova_cell1 Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writer thread running {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG nova.context [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2620343c-c8d1-48e6-ac23-7775ee8493ea(cell1) {{(pid=61613) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG oslo_db.sqlalchemy.engines [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61611) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG oslo_db.sqlalchemy.engines [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61611) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writer thread running {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:50:05 user devstack@n-api.service[61613]: INFO dbcounter [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Registered counter for database nova_cell0 Apr 19 13:50:05 user devstack@n-api.service[61613]: INFO dbcounter [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Registered counter for database nova_cell1 Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG oslo_db.sqlalchemy.engines [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61613) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writer thread running {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG oslo_db.sqlalchemy.engines [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61613) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG nova.context [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2620343c-c8d1-48e6-ac23-7775ee8493ea(cell1) {{(pid=61612) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:50:05 user devstack@n-api.service[61612]: INFO dbcounter [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Registered counter for database nova_cell0 Apr 19 13:50:05 user devstack@n-api.service[61612]: INFO dbcounter [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Registered counter for database nova_cell1 Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG oslo_db.sqlalchemy.engines [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61612) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writer thread running {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG oslo_db.sqlalchemy.engines [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61612) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writer thread running {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61611]: INFO dbcounter [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Registered counter for database nova_cell0 Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG oslo_db.sqlalchemy.engines [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61611) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writer thread running {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writer thread running {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61613]: INFO dbcounter [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Registered counter for database nova_cell0 Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG oslo_db.sqlalchemy.engines [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61613) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writer thread running {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writer thread running {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61612]: INFO dbcounter [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Registered counter for database nova_cell0 Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG oslo_db.sqlalchemy.engines [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61612) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 13:50:05 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writer thread running {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 13:50:05 user devstack@n-api.service[61613]: WARNING keystonemiddleware.auth_token [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 13:50:05 user devstack@n-api.service[61613]: WARNING keystonemiddleware.auth_token [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 13:50:05 user devstack@n-api.service[61611]: WARNING keystonemiddleware.auth_token [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 13:50:05 user devstack@n-api.service[61611]: WARNING keystonemiddleware.auth_token [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 13:50:05 user devstack@n-api.service[61612]: WARNING keystonemiddleware.auth_token [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 13:50:05 user devstack@n-api.service[61612]: WARNING keystonemiddleware.auth_token [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 13:50:06 user devstack@n-api.service[61611]: WARNING keystonemiddleware.auth_token [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 13:50:06 user devstack@n-api.service[61611]: WARNING keystonemiddleware.auth_token [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 13:50:06 user devstack@n-api.service[61611]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563701f26990 pid: 61611 (default app) Apr 19 13:50:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:50:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001516 Apr 19 13:50:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 19 13:50:06 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:50:06 user devstack@n-api.service[61613]: WARNING keystonemiddleware.auth_token [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 13:50:06 user devstack@n-api.service[61613]: WARNING keystonemiddleware.auth_token [None req-b465274d-7843-4b2d-8585-9f87d8163cfb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 13:50:06 user devstack@n-api.service[61613]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563701f26990 pid: 61613 (default app) Apr 19 13:50:06 user devstack@n-api.service[61612]: WARNING keystonemiddleware.auth_token [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 13:50:06 user devstack@n-api.service[61612]: WARNING keystonemiddleware.auth_token [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 13:50:06 user devstack@n-api.service[61612]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563701f26990 pid: 61612 (default app) Apr 19 13:52:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-bea651d1-28e5-409a-a9d9-acd1d72837f2 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001662 Apr 19 13:52:15 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:15 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:15 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:15 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:15 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:15 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-df93796e-d1b7-4065-bb8d-e6192f7b14a5 admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-df93796e-d1b7-4065-bb8d-e6192f7b14a5 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.443102 Apr 19 13:52:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 19 13:52:15 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 13:52:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002810 Apr 19 13:52:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:17 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:17 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:17 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:17 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:17 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f2a949c8-d0ec-483d-8405-0632eda9b10f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f2a949c8-d0ec-483d-8405-0632eda9b10f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.360613 Apr 19 13:52:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 13:52:17 2023] POST /compute/v2.1/flavors => generated 405 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:52:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-afce3734-6879-4dd6-b631-b282b90af7e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-afce3734-6879-4dd6-b631-b282b90af7e4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061399 Apr 19 13:52:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 13:52:18 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:52:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001556 Apr 19 13:52:20 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:20 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b221688b-526d-469e-85e4-b1490f91f0fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b221688b-526d-469e-85e4-b1490f91f0fe admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063523 Apr 19 13:52:20 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 13:52:20 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:52:20 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-9199e751-ab54-44ac-b49f-c0b49689bfbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-9199e751-ab54-44ac-b49f-c0b49689bfbc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029634 Apr 19 13:52:20 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 13:52:20 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:52:22 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001592 Apr 19 13:52:22 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:22 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-388125be-3a24-4dcd-a647-e89011bcc4ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:22 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-388125be-3a24-4dcd-a647-e89011bcc4ab admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079085 Apr 19 13:52:22 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 13:52:22 2023] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:52:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-24315665-0dc9-4b89-96b4-5499325b448a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-24315665-0dc9-4b89-96b4-5499325b448a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026116 Apr 19 13:52:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 13:52:22 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 13:52:24 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001559 Apr 19 13:52:24 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:24 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5d3d2741-91d0-418c-ba9c-51f1feff9c19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5d3d2741-91d0-418c-ba9c-51f1feff9c19 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063034 Apr 19 13:52:24 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 13:52:24 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:52:24 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-14243ac4-8fac-40aa-a010-57909f9bdeab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:24 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-14243ac4-8fac-40aa-a010-57909f9bdeab admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028857 Apr 19 13:52:24 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 13:52:24 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:52:26 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:26 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001637 Apr 19 13:52:26 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:26 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7c1d07a7-ba1d-4e54-9add-0c1e1f35160c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "vcpus": 4, "swap": 0, "ram": 4096, "disk": 20, "rxtx_factor": 1.0}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7c1d07a7-ba1d-4e54-9add-0c1e1f35160c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078917 Apr 19 13:52:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 13:52:26 2023] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:52:26 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025804 Apr 19 13:52:26 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 13:52:26 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:52:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-02eb622d-2335-41fc-aa56-39006115d7af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002493 Apr 19 13:52:28 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:28 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:28 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f4844d56-4d6f-400a-9917-146243a17de5 admin admin] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:28 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f4844d56-4d6f-400a-9917-146243a17de5 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.107702 Apr 19 13:52:28 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 19 13:52:28 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 13:52:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001635 Apr 19 13:52:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:30 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:30 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:30 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:30 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:30 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:52:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f57a1816-f068-4786-9e8d-b17e70587075 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "1", "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-f57a1816-f068-4786-9e8d-b17e70587075 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.344309 Apr 19 13:52:30 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 13:52:30 2023] POST /compute/v2.1/flavors => generated 400 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:52:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-6fd393f0-1d1c-49b1-b6c7-5f732f136da5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-6fd393f0-1d1c-49b1-b6c7-5f732f136da5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056366 Apr 19 13:52:30 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 13:52:30 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:52:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001323 Apr 19 13:52:32 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:32 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:32 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-51741065-06be-4552-bc5e-4201457ff4a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-51741065-06be-4552-bc5e-4201457ff4a4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.289575 Apr 19 13:52:33 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 13:52:32 2023] POST /compute/v2.1/flavors => generated 403 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:52:33 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-254b57ba-8496-49b9-b8fd-a96876cdd409 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:33 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-254b57ba-8496-49b9-b8fd-a96876cdd409 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027266 Apr 19 13:52:33 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 13:52:33 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:52:35 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002099 Apr 19 13:52:35 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:35 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-7c790132-2f72-40e1-b021-afc1a0440ded admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-7c790132-2f72-40e1-b021-afc1a0440ded admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.066319 Apr 19 13:52:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 13:52:35 2023] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:52:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c0a824e5-375a-4c47-b2ae-8a93cb9b4f56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c0a824e5-375a-4c47-b2ae-8a93cb9b4f56 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024685 Apr 19 13:52:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 13:52:35 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:52:37 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001432 Apr 19 13:52:37 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:37 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:37 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-44dddcea-04cd-444d-acb0-83d4129165a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:37 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-44dddcea-04cd-444d-acb0-83d4129165a0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068291 Apr 19 13:52:37 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 13:52:37 2023] POST /compute/v2.1/flavors => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:52:37 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-50e7cbc2-424e-4319-86d8-8e388db8d7b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:37 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-50e7cbc2-424e-4319-86d8-8e388db8d7b8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024721 Apr 19 13:52:37 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 13:52:37 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:52:39 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:52:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001421 Apr 19 13:52:39 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 13:52:39 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:52:39 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-86c9a6a7-6e0a-4f3b-846c-8ae4ccb9c61a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "ram": 16384}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-86c9a6a7-6e0a-4f3b-846c-8ae4ccb9c61a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.062085 Apr 19 13:52:39 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 13:52:39 2023] POST /compute/v2.1/flavors => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:52:39 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b26be982-96df-43de-9116-322071a70dcb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:52:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b26be982-96df-43de-9116-322071a70dcb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024075 Apr 19 13:52:39 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 13:52:39 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:53:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:53:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-08322223-f32b-44fd-997f-56a581d8ba5e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001442 Apr 19 13:53:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 13:53:09 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:53:09 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:53:09 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:53:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:53:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:53:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:53:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:53:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:53:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:53:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.096620 Apr 19 13:53:09 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 19 13:53:09 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:53:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b26be982-96df-43de-9116-322071a70dcb admin admin] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:53:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b26be982-96df-43de-9116-322071a70dcb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001669 Apr 19 13:53:41 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 13:53:41 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:53:41 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:53:41 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-64362741-7de3-44fa-8890-bb6dbee7c445 admin admin] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:53:41 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-64362741-7de3-44fa-8890-bb6dbee7c445 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.068675 Apr 19 13:53:41 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 19 13:53:41 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 13:53:45 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:53:45 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001884 Apr 19 13:53:45 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 13:53:45 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:53:45 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:53:45 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-37252773-75f2-4ef4-b507-539a97047f70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 128, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "42", "os-flavor-access:is_public": true, "name": "m1.nano", "disk": 1, "swap": 0}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:53:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-37252773-75f2-4ef4-b507-539a97047f70 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.077649 Apr 19 13:53:45 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 19 13:53:45 2023] POST /compute/v2.1/flavors => generated 403 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:53:45 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-eabc3a88-5b1c-4bd9-b032-f2879ce292ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:53:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-eabc3a88-5b1c-4bd9-b032-f2879ce292ac admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026987 Apr 19 13:53:45 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 19 13:53:45 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:53:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:53:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-95a88cce-43e9-4a7c-9182-a3d2bc2433d1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001533 Apr 19 13:53:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 13:53:49 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 13:53:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8e12a1a8-f0f3-4e2e-b4aa-dafc559e7884 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "84", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 192, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.micro"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:53:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8e12a1a8-f0f3-4e2e-b4aa-dafc559e7884 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068415 Apr 19 13:53:49 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 19 13:53:49 2023] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:53:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-19a7f605-2d9a-403c-ac1e-c125241e08e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:53:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-19a7f605-2d9a-403c-ac1e-c125241e08e3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030054 Apr 19 13:53:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 19 13:53:49 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:56:20 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:20 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:20 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-25b53c67-5705-4599-b0a8-a57acddf2031 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Action: 'create', calling method: .version_select at 0x7f60df001ab0>, body: {"keypair": {"name": "tempest-keypair-1442750450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHo4+s65lOoyThfJZEXLVxMvtMlxsd5/eS5skGMEiNHfCGflKmfpQOoqBGYlU+aXygGpgtH+dtPJYniG1RBXa02GN0WLyKphJcrmVUoJVcuaIHtvy00dzLL0f5VY6dEO1A=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:20 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-25b53c67-5705-4599-b0a8-a57acddf2031 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Getting quotas for project 8d2b244a7fcf46baab5d636ba6e58fb7. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:56:20 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-25b53c67-5705-4599-b0a8-a57acddf2031 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Getting quotas for user 825cd7cdbfad406197e3230a687dcfcc and project 8d2b244a7fcf46baab5d636ba6e58fb7. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:56:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-25b53c67-5705-4599-b0a8-a57acddf2031 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.238645 Apr 19 13:56:20 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 15/46] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 19 13:56:20 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 241 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 19 13:56:21 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e309f7d0-082f-4fc8-a0cf-360f582e816a tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Action: 'create', calling method: .version_select at 0x7f60df19a290>, body: {"keypair": {"name": "tempest-keypair-800659709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7WsLpMuR+OTcCmUhLNMbCIVWO2bzRuMFsWyhLkPo+i4B2u0oZvMhSVo0VdEoZpXGXVrNPeI55GPzDG4WiCLIwV0tZQrncUBhpHi5kCYfehSX1dLlF6pk+R8F2c+fNtmw=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:21 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-e309f7d0-082f-4fc8-a0cf-360f582e816a tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Getting quotas for project f754b42ccea544d4a34e986a6119db51. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:56:21 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-e309f7d0-082f-4fc8-a0cf-360f582e816a tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Getting quotas for user af3a097ff4d04a0287c417b23d3b00e4 and project f754b42ccea544d4a34e986a6119db51. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:56:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e309f7d0-082f-4fc8-a0cf-360f582e816a tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.341156 Apr 19 13:56:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 13:56:21 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:56:28 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:28 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1235816152", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "networks": [{"uuid": "caaf8983-bab2-4dbe-916b-cfac23159fe5"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:29 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] validate_networks() for [('caaf8983-bab2-4dbe-916b-cfac23159fe5', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:56:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-201128357", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "032bf858-1d5a-4124-8a42-813b354ac034"}], "security_groups": [{"name": "tempest-securitygroup--2099518783"}], "key_name": "tempest-keypair-1442750450", "user_data": "}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:29 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] validate_networks() for [('032bf858-1d5a-4124-8a42-813b354ac034', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:56:30 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:30 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1092100961", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "networks": [{"uuid": "855eeee5-1168-470f-a52d-b261456f2393"}], "security_groups": [{"name": "tempest-securitygroup--987188955"}], "key_name": "tempest-keypair-800659709", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Getting quotas for project 1c9b8f883c474db9a4e766b9262f4217. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Getting quotas for user 6005f003a23749bd9b9b00c87dec971c and project 1c9b8f883c474db9a4e766b9262f4217. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] [instance: df6a7f5d-e8d6-4a01-90e4-6869692de6b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:56:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1a8b989c-b58f-4645-9319-6785ecb051dc tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.147919 Apr 19 13:56:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 13:56:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-96a3edad-063d-4970-b533-88053677a4de tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-96a3edad-063d-4970-b533-88053677a4de tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] [instance: df6a7f5d-e8d6-4a01-90e4-6869692de6b7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:56:30 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-96a3edad-063d-4970-b533-88053677a4de tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6005f003a23749bd9b9b00c87dec971c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9b8f883c474db9a4e766b9262f4217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:56:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-96a3edad-063d-4970-b533-88053677a4de tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7" status: 200 len: 1209 microversion: 2.1 time: 0.148588 Apr 19 13:56:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 17/49] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:56:30 2023] GET /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7 => generated 1209 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Getting quotas for project 8d2b244a7fcf46baab5d636ba6e58fb7. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Getting quotas for user 825cd7cdbfad406197e3230a687dcfcc and project 8d2b244a7fcf46baab5d636ba6e58fb7. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:56:31 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:56:31 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] validate_networks() for [('855eeee5-1168-470f-a52d-b261456f2393', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:56:31 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0f662002-e238-4466-92c8-9713af7e26cd tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.157147 Apr 19 13:56:31 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 16/50] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 13:56:29 2023] POST /compute/v2.1/servers => generated 400 bytes in 2159 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 13:56:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b302fe3f-b6b2-424c-9df4-5bf91d28d46b tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:56:31 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b302fe3f-b6b2-424c-9df4-5bf91d28d46b tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:56:31 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b302fe3f-b6b2-424c-9df4-5bf91d28d46b tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:56:31 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b302fe3f-b6b2-424c-9df4-5bf91d28d46b tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:56:31 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b302fe3f-b6b2-424c-9df4-5bf91d28d46b tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:56:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b302fe3f-b6b2-424c-9df4-5bf91d28d46b tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b" status: 200 len: 1275 microversion: 2.20 time: 0.104353 Apr 19 13:56:31 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 18/51] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 13:56:31 2023] GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 13:56:31 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Getting quotas for project f754b42ccea544d4a34e986a6119db51. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Getting quotas for user af3a097ff4d04a0287c417b23d3b00e4 and project f754b42ccea544d4a34e986a6119db51. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:56:32 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:56:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f349c119-2d99-468a-9a10-a1d51012b0be tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.555722 Apr 19 13:56:32 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 18/52] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 13:56:30 2023] POST /compute/v2.1/servers => generated 403 bytes in 2557 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 13:56:32 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d1d5f27a-09e9-4f00-90c6-299b39e20e18 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:56:32 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d1d5f27a-09e9-4f00-90c6-299b39e20e18 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:56:33 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-d1d5f27a-09e9-4f00-90c6-299b39e20e18 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3a097ff4d04a0287c417b23d3b00e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f754b42ccea544d4a34e986a6119db51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:56:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d1d5f27a-09e9-4f00-90c6-299b39e20e18 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f" status: 200 len: 1239 microversion: 2.1 time: 0.192113 Apr 19 13:56:33 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 17/53] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:56:32 2023] GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f => generated 1239 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-aea8aa37-5184-44a0-a1ca-2429d2e7b3ae req-beca5f91-4995-4077-b8db-b3495009c4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c95eb6-9d18-41fa-b334-0c423a01241b", "tag": "dd69fbb4-0eaf-4284-b851-00660dd803c4"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-aea8aa37-5184-44a0-a1ca-2429d2e7b3ae req-beca5f91-4995-4077-b8db-b3495009c4b3 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-aea8aa37-5184-44a0-a1ca-2429d2e7b3ae req-beca5f91-4995-4077-b8db-b3495009c4b3 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-aea8aa37-5184-44a0-a1ca-2429d2e7b3ae req-beca5f91-4995-4077-b8db-b3495009c4b3 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-aea8aa37-5184-44a0-a1ca-2429d2e7b3ae req-beca5f91-4995-4077-b8db-b3495009c4b3 service nova] Creating event network-changed:dd69fbb4-0eaf-4284-b851-00660dd803c4 for instance 20c95eb6-9d18-41fa-b334-0c423a01241b on user Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-aea8aa37-5184-44a0-a1ca-2429d2e7b3ae req-beca5f91-4995-4077-b8db-b3495009c4b3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61613) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-aea8aa37-5184-44a0-a1ca-2429d2e7b3ae req-beca5f91-4995-4077-b8db-b3495009c4b3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61613) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-93db0d32-9a2a-4f04-b87a-d64ef00ded7f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-93db0d32-9a2a-4f04-b87a-d64ef00ded7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-93db0d32-9a2a-4f04-b87a-d64ef00ded7f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-93db0d32-9a2a-4f04-b87a-d64ef00ded7f None None] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-93db0d32-9a2a-4f04-b87a-d64ef00ded7f None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-93db0d32-9a2a-4f04-b87a-d64ef00ded7f None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:39 user devstack@n-api.service[61613]: INFO nova.compute.rpcapi [None req-93db0d32-9a2a-4f04-b87a-d64ef00ded7f None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 13:56:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-93db0d32-9a2a-4f04-b87a-d64ef00ded7f None None] Releasing lock "compute-rpcapi-router" {{(pid=61613) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 13:56:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-93db0d32-9a2a-4f04-b87a-d64ef00ded7f None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127093 Apr 19 13:56:39 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 19/54] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:56:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-9eded4f9-7897-4cbc-bc15-840321260b10 req-356078c8-2ff7-40f3-a400-8c942681727a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6a7f5d-e8d6-4a01-90e4-6869692de6b7", "tag": "c8a25e67-fccb-4889-b460-c9843a2e232d"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9eded4f9-7897-4cbc-bc15-840321260b10 req-356078c8-2ff7-40f3-a400-8c942681727a service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9eded4f9-7897-4cbc-bc15-840321260b10 req-356078c8-2ff7-40f3-a400-8c942681727a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9eded4f9-7897-4cbc-bc15-840321260b10 req-356078c8-2ff7-40f3-a400-8c942681727a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:40 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9eded4f9-7897-4cbc-bc15-840321260b10 req-356078c8-2ff7-40f3-a400-8c942681727a service nova] Creating event network-changed:c8a25e67-fccb-4889-b460-c9843a2e232d for instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 on user Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9eded4f9-7897-4cbc-bc15-840321260b10 req-356078c8-2ff7-40f3-a400-8c942681727a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61611) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9eded4f9-7897-4cbc-bc15-840321260b10 req-356078c8-2ff7-40f3-a400-8c942681727a service nova] Acquired lock "compute-rpcapi-router" {{(pid=61611) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-afe3223b-2b65-4b88-8ef1-fce9429045d5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-afe3223b-2b65-4b88-8ef1-fce9429045d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-afe3223b-2b65-4b88-8ef1-fce9429045d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-afe3223b-2b65-4b88-8ef1-fce9429045d5 None None] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-afe3223b-2b65-4b88-8ef1-fce9429045d5 None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-afe3223b-2b65-4b88-8ef1-fce9429045d5 None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:40 user devstack@n-api.service[61611]: INFO nova.compute.rpcapi [None req-afe3223b-2b65-4b88-8ef1-fce9429045d5 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 13:56:40 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-afe3223b-2b65-4b88-8ef1-fce9429045d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=61611) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 13:56:40 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-afe3223b-2b65-4b88-8ef1-fce9429045d5 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146690 Apr 19 13:56:40 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 19/55] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:56:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-0f2c8063-1f55-48d9-9872-55c9068f972b req-017efa34-749c-4f53-b225-a908ef5157dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0f2c8063-1f55-48d9-9872-55c9068f972b req-017efa34-749c-4f53-b225-a908ef5157dd service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0f2c8063-1f55-48d9-9872-55c9068f972b req-017efa34-749c-4f53-b225-a908ef5157dd service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0f2c8063-1f55-48d9-9872-55c9068f972b req-017efa34-749c-4f53-b225-a908ef5157dd service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-0f2c8063-1f55-48d9-9872-55c9068f972b req-017efa34-749c-4f53-b225-a908ef5157dd service nova] Creating event network-changed:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0f2c8063-1f55-48d9-9872-55c9068f972b req-017efa34-749c-4f53-b225-a908ef5157dd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61612) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0f2c8063-1f55-48d9-9872-55c9068f972b req-017efa34-749c-4f53-b225-a908ef5157dd service nova] Acquired lock "compute-rpcapi-router" {{(pid=61612) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3872004a-043f-4689-ae87-ccd089eec774 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3872004a-043f-4689-ae87-ccd089eec774 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3872004a-043f-4689-ae87-ccd089eec774 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3872004a-043f-4689-ae87-ccd089eec774 None None] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3872004a-043f-4689-ae87-ccd089eec774 None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3872004a-043f-4689-ae87-ccd089eec774 None None] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:41 user devstack@n-api.service[61612]: INFO nova.compute.rpcapi [None req-3872004a-043f-4689-ae87-ccd089eec774 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 13:56:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3872004a-043f-4689-ae87-ccd089eec774 None None] Releasing lock "compute-rpcapi-router" {{(pid=61612) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 13:56:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3872004a-043f-4689-ae87-ccd089eec774 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118103 Apr 19 13:56:41 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 18/56] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:56:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:56:42 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=10 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:42 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8ae21036-31c4-4565-ab41-51fef4c03779 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Action: 'create', calling method: .version_select at 0x7f60de72b5b0>, body: {"keypair": {"name": "tempest-keypair-123040742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIw03ihlQ3rkdlCp0C0/8Aa5Lg4QjElQ4PGsZy7VYL9Zmv4voEnLRO7IES069oqJnTvpZ9mWHKKO9quK7tbTyjEnfBXz/7YoLkTdgMM8AMkFkbGBQHry1HHlqWcW70mm5A=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:42 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-8ae21036-31c4-4565-ab41-51fef4c03779 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Getting quotas for project b882fb2e40e74c88a69342ca2385b28f. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:56:42 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-8ae21036-31c4-4565-ab41-51fef4c03779 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Getting quotas for user ee0088ff4bd64218b490c3414afb1c76 and project b882fb2e40e74c88a69342ca2385b28f. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:56:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8ae21036-31c4-4565-ab41-51fef4c03779 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.340255 Apr 19 13:56:42 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 20/57] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 13:56:42 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:56:46 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-862931616", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "networks": [{"uuid": "50d1390b-26bc-4e35-bf52-a3afc6e414f8"}], "security_groups": [{"name": "tempest-securitygroup--1565722656"}], "key_name": "tempest-keypair-123040742", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:47 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] validate_networks() for [('50d1390b-26bc-4e35-bf52-a3afc6e414f8', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Getting quotas for project b882fb2e40e74c88a69342ca2385b28f. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Getting quotas for user ee0088ff4bd64218b490c3414afb1c76 and project b882fb2e40e74c88a69342ca2385b28f. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:56:49 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: dee689b0-177a-4265-a296-c75cd57e74ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:56:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4176adb4-86a7-4a2d-9c33-41ec968fb544 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.288138 Apr 19 13:56:49 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 20/58] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 13:56:46 2023] POST /compute/v2.1/servers => generated 404 bytes in 2290 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 13:56:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0d2e45a5-3483-4787-bd5a-69e06f685842 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:56:49 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0d2e45a5-3483-4787-bd5a-69e06f685842 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: dee689b0-177a-4265-a296-c75cd57e74ba] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:56:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:49 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-0d2e45a5-3483-4787-bd5a-69e06f685842 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0088ff4bd64218b490c3414afb1c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b882fb2e40e74c88a69342ca2385b28f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:56:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0d2e45a5-3483-4787-bd5a-69e06f685842 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba" status: 200 len: 1234 microversion: 2.1 time: 0.234666 Apr 19 13:56:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 19/59] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:56:49 2023] GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba => generated 1234 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:56:50 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-a0018674-b9a6-4a1d-8e2f-9721221bb5f4 req-e6480356-5852-4d41-9c4e-d17bd75e5da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "name": "network-vif-plugged", "status": "completed", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:50 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:50 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a0018674-b9a6-4a1d-8e2f-9721221bb5f4 req-e6480356-5852-4d41-9c4e-d17bd75e5da3 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a0018674-b9a6-4a1d-8e2f-9721221bb5f4 req-e6480356-5852-4d41-9c4e-d17bd75e5da3 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:50 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a0018674-b9a6-4a1d-8e2f-9721221bb5f4 req-e6480356-5852-4d41-9c4e-d17bd75e5da3 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a0018674-b9a6-4a1d-8e2f-9721221bb5f4 req-e6480356-5852-4d41-9c4e-d17bd75e5da3 service nova] Creating event network-vif-plugged:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 13:56:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-a0018674-b9a6-4a1d-8e2f-9721221bb5f4 req-e6480356-5852-4d41-9c4e-d17bd75e5da3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067297 Apr 19 13:56:50 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 21/60] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:56:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:56:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-45ebfd43-f417-46b3-8c3c-25394de91cba req-adaf599e-f016-420c-bc35-f04889ef215f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "name": "network-vif-plugged", "status": "completed", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}, {"server_uuid": "20c95eb6-9d18-41fa-b334-0c423a01241b", "name": "network-vif-plugged", "status": "completed", "tag": "dd69fbb4-0eaf-4284-b851-00660dd803c4"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:52 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=7 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-45ebfd43-f417-46b3-8c3c-25394de91cba req-adaf599e-f016-420c-bc35-f04889ef215f service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-45ebfd43-f417-46b3-8c3c-25394de91cba req-adaf599e-f016-420c-bc35-f04889ef215f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-45ebfd43-f417-46b3-8c3c-25394de91cba req-adaf599e-f016-420c-bc35-f04889ef215f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-45ebfd43-f417-46b3-8c3c-25394de91cba req-adaf599e-f016-420c-bc35-f04889ef215f service nova] Creating event network-vif-plugged:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 13:56:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-45ebfd43-f417-46b3-8c3c-25394de91cba req-adaf599e-f016-420c-bc35-f04889ef215f service nova] Creating event network-vif-plugged:dd69fbb4-0eaf-4284-b851-00660dd803c4 for instance 20c95eb6-9d18-41fa-b334-0c423a01241b on user Apr 19 13:56:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-45ebfd43-f417-46b3-8c3c-25394de91cba req-adaf599e-f016-420c-bc35-f04889ef215f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041663 Apr 19 13:56:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 21/61] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:56:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:56:54 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a7bf538e-c9ed-4279-bd8e-d8a02cfdb07d req-cff5f49d-d8ab-4f12-8aad-3978bf09dd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c95eb6-9d18-41fa-b334-0c423a01241b", "name": "network-vif-plugged", "status": "completed", "tag": "dd69fbb4-0eaf-4284-b851-00660dd803c4"}, {"server_uuid": "df6a7f5d-e8d6-4a01-90e4-6869692de6b7", "name": "network-vif-plugged", "status": "completed", "tag": "c8a25e67-fccb-4889-b460-c9843a2e232d"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:54 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:54 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:54 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a7bf538e-c9ed-4279-bd8e-d8a02cfdb07d req-cff5f49d-d8ab-4f12-8aad-3978bf09dd88 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a7bf538e-c9ed-4279-bd8e-d8a02cfdb07d req-cff5f49d-d8ab-4f12-8aad-3978bf09dd88 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a7bf538e-c9ed-4279-bd8e-d8a02cfdb07d req-cff5f49d-d8ab-4f12-8aad-3978bf09dd88 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a7bf538e-c9ed-4279-bd8e-d8a02cfdb07d req-cff5f49d-d8ab-4f12-8aad-3978bf09dd88 service nova] Creating event network-vif-plugged:dd69fbb4-0eaf-4284-b851-00660dd803c4 for instance 20c95eb6-9d18-41fa-b334-0c423a01241b on user Apr 19 13:56:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a7bf538e-c9ed-4279-bd8e-d8a02cfdb07d req-cff5f49d-d8ab-4f12-8aad-3978bf09dd88 service nova] Creating event network-vif-plugged:c8a25e67-fccb-4889-b460-c9843a2e232d for instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 on user Apr 19 13:56:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a7bf538e-c9ed-4279-bd8e-d8a02cfdb07d req-cff5f49d-d8ab-4f12-8aad-3978bf09dd88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.127993 Apr 19 13:56:54 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 20/62] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:56:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:56:55 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cb688175-28e3-4f59-8163-89fb45cfc4b8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Action: 'create', calling method: .version_select at 0x7f60de78a200>, body: {"keypair": {"name": "tempest-keypair-1297891626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5idzGAbfRtdyU0dzY5ijDynA5rh6O+uo+7fSsU97aoaEQlI/6HJboZqLuIYJ7MDSb+pPdYMmAxdoWvMOloDpnYeqYtFUuZ/5ycB2RzKQeP+ORa+toG3tq0EP6ErzZtmA=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:55 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-cb688175-28e3-4f59-8163-89fb45cfc4b8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Getting quotas for project e0dfe1cb247c4e68bd5dbbe1ccce3100. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:56:55 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-cb688175-28e3-4f59-8163-89fb45cfc4b8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Getting quotas for user efd0c03d870041c58e7a857d65e066cc and project e0dfe1cb247c4e68bd5dbbe1ccce3100. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:56:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-cb688175-28e3-4f59-8163-89fb45cfc4b8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.245362 Apr 19 13:56:55 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 22/63] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 13:56:55 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 13:56:56 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-060f3845-65b4-457e-b6aa-81ab647f5c72 req-339ba2b7-55ba-4e6c-ac3a-cef7a98ada9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6a7f5d-e8d6-4a01-90e4-6869692de6b7", "name": "network-vif-plugged", "status": "completed", "tag": "c8a25e67-fccb-4889-b460-c9843a2e232d"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-060f3845-65b4-457e-b6aa-81ab647f5c72 req-339ba2b7-55ba-4e6c-ac3a-cef7a98ada9e service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-060f3845-65b4-457e-b6aa-81ab647f5c72 req-339ba2b7-55ba-4e6c-ac3a-cef7a98ada9e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-060f3845-65b4-457e-b6aa-81ab647f5c72 req-339ba2b7-55ba-4e6c-ac3a-cef7a98ada9e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:56 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-060f3845-65b4-457e-b6aa-81ab647f5c72 req-339ba2b7-55ba-4e6c-ac3a-cef7a98ada9e service nova] Creating event network-vif-plugged:c8a25e67-fccb-4889-b460-c9843a2e232d for instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 on user Apr 19 13:56:56 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-060f3845-65b4-457e-b6aa-81ab647f5c72 req-339ba2b7-55ba-4e6c-ac3a-cef7a98ada9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046864 Apr 19 13:56:56 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 22/64] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:56:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:56:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-0d8e3e41-cff8-43a4-b93a-172d68c58859 req-94fae2ff-a2bb-47e0-8034-b71bcf91303c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee689b0-177a-4265-a296-c75cd57e74ba", "tag": "18f0605d-b40a-40a3-9eda-f2d5c5a95867"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0d8e3e41-cff8-43a4-b93a-172d68c58859 req-94fae2ff-a2bb-47e0-8034-b71bcf91303c service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0d8e3e41-cff8-43a4-b93a-172d68c58859 req-94fae2ff-a2bb-47e0-8034-b71bcf91303c service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-0d8e3e41-cff8-43a4-b93a-172d68c58859 req-94fae2ff-a2bb-47e0-8034-b71bcf91303c service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-0d8e3e41-cff8-43a4-b93a-172d68c58859 req-94fae2ff-a2bb-47e0-8034-b71bcf91303c service nova] Creating event network-changed:18f0605d-b40a-40a3-9eda-f2d5c5a95867 for instance dee689b0-177a-4265-a296-c75cd57e74ba on user Apr 19 13:56:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-0d8e3e41-cff8-43a4-b93a-172d68c58859 req-94fae2ff-a2bb-47e0-8034-b71bcf91303c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045804 Apr 19 13:56:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 21/65] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:56:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:56:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-abd63182-dcf4-4d49-ba8c-b8045436d61e req-e8377524-6964-4cbe-b336-5acb41c11300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee689b0-177a-4265-a296-c75cd57e74ba", "name": "network-vif-plugged", "status": "completed", "tag": "18f0605d-b40a-40a3-9eda-f2d5c5a95867"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:56:59 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=5 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:56:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-abd63182-dcf4-4d49-ba8c-b8045436d61e req-e8377524-6964-4cbe-b336-5acb41c11300 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:56:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-abd63182-dcf4-4d49-ba8c-b8045436d61e req-e8377524-6964-4cbe-b336-5acb41c11300 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:56:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-abd63182-dcf4-4d49-ba8c-b8045436d61e req-e8377524-6964-4cbe-b336-5acb41c11300 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:56:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-abd63182-dcf4-4d49-ba8c-b8045436d61e req-e8377524-6964-4cbe-b336-5acb41c11300 service nova] Creating event network-vif-plugged:18f0605d-b40a-40a3-9eda-f2d5c5a95867 for instance dee689b0-177a-4265-a296-c75cd57e74ba on user Apr 19 13:56:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-abd63182-dcf4-4d49-ba8c-b8045436d61e req-e8377524-6964-4cbe-b336-5acb41c11300 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058853 Apr 19 13:56:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 23/66] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:56:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:00 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1852257145", "imageRef": "d5d84416-ccb7-4861-a92b-838b56f00f53", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "8c1e9426-fa80-413b-85f6-9ee55d3f8bd5"}], "security_groups": [{"name": "tempest-securitygroup--1536055660"}], "key_name": "tempest-keypair-1297891626", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:00 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:00 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:01 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] validate_networks() for [('8c1e9426-fa80-413b-85f6-9ee55d3f8bd5', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:57:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-21381f26-f479-4d13-a194-4b5e1df66d39 req-6ce64a09-2b94-44f4-9a8f-e5e24e0b4da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee689b0-177a-4265-a296-c75cd57e74ba", "name": "network-vif-plugged", "status": "completed", "tag": "18f0605d-b40a-40a3-9eda-f2d5c5a95867"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:01 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-21381f26-f479-4d13-a194-4b5e1df66d39 req-6ce64a09-2b94-44f4-9a8f-e5e24e0b4da6 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-21381f26-f479-4d13-a194-4b5e1df66d39 req-6ce64a09-2b94-44f4-9a8f-e5e24e0b4da6 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-21381f26-f479-4d13-a194-4b5e1df66d39 req-6ce64a09-2b94-44f4-9a8f-e5e24e0b4da6 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-21381f26-f479-4d13-a194-4b5e1df66d39 req-6ce64a09-2b94-44f4-9a8f-e5e24e0b4da6 service nova] Creating event network-vif-plugged:18f0605d-b40a-40a3-9eda-f2d5c5a95867 for instance dee689b0-177a-4265-a296-c75cd57e74ba on user Apr 19 13:57:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-21381f26-f479-4d13-a194-4b5e1df66d39 req-6ce64a09-2b94-44f4-9a8f-e5e24e0b4da6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037824 Apr 19 13:57:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=13 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:03 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Getting quotas for project e0dfe1cb247c4e68bd5dbbe1ccce3100. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:57:03 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Getting quotas for user efd0c03d870041c58e7a857d65e066cc and project e0dfe1cb247c4e68bd5dbbe1ccce3100. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:57:03 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:57:03 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] [instance: 0b41bbd3-cf76-4be0-8d76-c22496a7fe23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5d84416-ccb7-4861-a92b-838b56f00f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:57:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-50da5059-7ac2-4a30-b189-589c233f87a9 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.153356 Apr 19 13:57:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 23/68] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 13:57:00 2023] POST /compute/v2.1/servers => generated 404 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 13:57:03 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-be97910c-e63e-41af-b39a-d562a5a5cd05 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:03 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-be97910c-e63e-41af-b39a-d562a5a5cd05 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] [instance: 0b41bbd3-cf76-4be0-8d76-c22496a7fe23] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:57:03 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-be97910c-e63e-41af-b39a-d562a5a5cd05 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd0c03d870041c58e7a857d65e066cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dfe1cb247c4e68bd5dbbe1ccce3100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-be97910c-e63e-41af-b39a-d562a5a5cd05 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23" status: 200 len: 1240 microversion: 2.1 time: 0.134155 Apr 19 13:57:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 24/69] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:57:03 2023] GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23 => generated 1240 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:57:09 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-7891e680-6380-4b55-bb36-c05aa1c5b98f req-2f6d08b7-03bf-4de7-886f-1c3d2da06fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b41bbd3-cf76-4be0-8d76-c22496a7fe23", "tag": "68aa0fed-082c-48a5-905f-b1fe97b83dbb"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7891e680-6380-4b55-bb36-c05aa1c5b98f req-2f6d08b7-03bf-4de7-886f-1c3d2da06fe0 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7891e680-6380-4b55-bb36-c05aa1c5b98f req-2f6d08b7-03bf-4de7-886f-1c3d2da06fe0 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-7891e680-6380-4b55-bb36-c05aa1c5b98f req-2f6d08b7-03bf-4de7-886f-1c3d2da06fe0 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-7891e680-6380-4b55-bb36-c05aa1c5b98f req-2f6d08b7-03bf-4de7-886f-1c3d2da06fe0 service nova] Creating event network-changed:68aa0fed-082c-48a5-905f-b1fe97b83dbb for instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 on user Apr 19 13:57:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-7891e680-6380-4b55-bb36-c05aa1c5b98f req-2f6d08b7-03bf-4de7-886f-1c3d2da06fe0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041264 Apr 19 13:57:09 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 23/70] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-fa46dad0-c93a-479e-a86b-b9db7c626d1e tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Action: 'create', calling method: .version_select at 0x7f60de70d870>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1510315384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwhSluZ6Zuz52SGaeUAYiIxEdfRIizucanApqGvuPwKHT4SB4bQ5e5gSXzUknI45K+UFz0kDZBIrpYR0CXk9jrW6dZOwUbSWuhXskNoqHT7h7/IXv5GMjuAvkR7Tof8nw=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:10 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-fa46dad0-c93a-479e-a86b-b9db7c626d1e tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Getting quotas for project 833c753ebd4a43f3a70e30069a91f159. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:57:10 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-fa46dad0-c93a-479e-a86b-b9db7c626d1e tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Getting quotas for user 659c76db8ca8424a8c46a43936dfc7a4 and project 833c753ebd4a43f3a70e30069a91f159. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:57:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-fa46dad0-c93a-479e-a86b-b9db7c626d1e tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051837 Apr 19 13:57:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 24/71] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 13:57:10 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:10 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1861434802", "imageRef": "0b71e383-e151-45bd-9009-ff73f4ea6dbb", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1510315384", "networks": [{"uuid": "fa47499b-5227-4a96-b974-d57fa75d62ba"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:10 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:10 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] validate_networks() for [('fa47499b-5227-4a96-b974-d57fa75d62ba', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:57:11 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-ebb20b84-877e-425e-8b6e-754f1043386e tempest-TestShelveInstance-1101965331 tempest-TestShelveInstance-1101965331-project-member] Action: 'create', calling method: .version_select at 0x7f60def6ff40>, body: {"keypair": {"name": "tempest-TestShelveInstance-81536929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTnX75LKNpk9O+Nlb7/D6IM7O2/BrxqLuDu385wjf3msIJkdyUBFWNLdFiHsMzQVvWBM9Ehn017hArZYtQMgdiAK7dTyZiYDNkI60bcpxKsxLNcpVfVxKqrhgUrVu8uUQ=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:11 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-ebb20b84-877e-425e-8b6e-754f1043386e tempest-TestShelveInstance-1101965331 tempest-TestShelveInstance-1101965331-project-member] Getting quotas for project 1eba62f7c4e44b15b844f9886d2cdf68. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:57:11 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-ebb20b84-877e-425e-8b6e-754f1043386e tempest-TestShelveInstance-1101965331 tempest-TestShelveInstance-1101965331-project-member] Getting quotas for user 69c329498f5a484c962ec2bc7e084abf and project 1eba62f7c4e44b15b844f9886d2cdf68. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:57:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-ebb20b84-877e-425e-8b6e-754f1043386e tempest-TestShelveInstance-1101965331 tempest-TestShelveInstance-1101965331-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.355764 Apr 19 13:57:11 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 24/72] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 13:57:11 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Getting quotas for project 833c753ebd4a43f3a70e30069a91f159. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Getting quotas for user 659c76db8ca8424a8c46a43936dfc7a4 and project 833c753ebd4a43f3a70e30069a91f159. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:57:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 33751f45-cd9e-4b2c-ad4d-1049db7ef555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b71e383-e151-45bd-9009-ff73f4ea6dbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:57:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-18e00e9d-8c7b-4fc0-834e-5ca0a20b2180 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.381725 Apr 19 13:57:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 25/73] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 13:57:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 13:57:12 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d7930e04-3f0d-49f0-923d-426a69ba5f10 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:12 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d7930e04-3f0d-49f0-923d-426a69ba5f10 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 33751f45-cd9e-4b2c-ad4d-1049db7ef555] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:57:12 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-d7930e04-3f0d-49f0-923d-426a69ba5f10 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:12 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d7930e04-3f0d-49f0-923d-426a69ba5f10 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555" status: 200 len: 1253 microversion: 2.1 time: 0.163047 Apr 19 13:57:12 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 25/74] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:57:12 2023] GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555 => generated 1253 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:57:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-15591911-b772-4c0f-9b0f-3d390a75c35b req-174b6560-476b-44a1-9efd-67ad45f85b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b41bbd3-cf76-4be0-8d76-c22496a7fe23", "name": "network-vif-plugged", "status": "completed", "tag": "68aa0fed-082c-48a5-905f-b1fe97b83dbb"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-15591911-b772-4c0f-9b0f-3d390a75c35b req-174b6560-476b-44a1-9efd-67ad45f85b00 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-15591911-b772-4c0f-9b0f-3d390a75c35b req-174b6560-476b-44a1-9efd-67ad45f85b00 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-15591911-b772-4c0f-9b0f-3d390a75c35b req-174b6560-476b-44a1-9efd-67ad45f85b00 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-15591911-b772-4c0f-9b0f-3d390a75c35b req-174b6560-476b-44a1-9efd-67ad45f85b00 service nova] Creating event network-vif-plugged:68aa0fed-082c-48a5-905f-b1fe97b83dbb for instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 on user Apr 19 13:57:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-15591911-b772-4c0f-9b0f-3d390a75c35b req-174b6560-476b-44a1-9efd-67ad45f85b00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041773 Apr 19 13:57:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-265a588d-8895-415b-894f-3a8a156826a2 req-cb66f09b-33ba-4966-9a22-b11e1cc8d9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b41bbd3-cf76-4be0-8d76-c22496a7fe23", "name": "network-vif-plugged", "status": "completed", "tag": "68aa0fed-082c-48a5-905f-b1fe97b83dbb"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-265a588d-8895-415b-894f-3a8a156826a2 req-cb66f09b-33ba-4966-9a22-b11e1cc8d9d8 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-265a588d-8895-415b-894f-3a8a156826a2 req-cb66f09b-33ba-4966-9a22-b11e1cc8d9d8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-265a588d-8895-415b-894f-3a8a156826a2 req-cb66f09b-33ba-4966-9a22-b11e1cc8d9d8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-265a588d-8895-415b-894f-3a8a156826a2 req-cb66f09b-33ba-4966-9a22-b11e1cc8d9d8 service nova] Creating event network-vif-plugged:68aa0fed-082c-48a5-905f-b1fe97b83dbb for instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 on user Apr 19 13:57:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-265a588d-8895-415b-894f-3a8a156826a2 req-cb66f09b-33ba-4966-9a22-b11e1cc8d9d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033261 Apr 19 13:57:15 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 26/76] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-0695399a-1118-4302-b9d4-6167dd49c143 req-cbcba325-536f-461f-8d9e-afc88c2cce64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33751f45-cd9e-4b2c-ad4d-1049db7ef555", "tag": "02e84e5e-7d3e-4135-93fb-49791bf9f3f1"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:16 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:16 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0695399a-1118-4302-b9d4-6167dd49c143 req-cbcba325-536f-461f-8d9e-afc88c2cce64 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0695399a-1118-4302-b9d4-6167dd49c143 req-cbcba325-536f-461f-8d9e-afc88c2cce64 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0695399a-1118-4302-b9d4-6167dd49c143 req-cbcba325-536f-461f-8d9e-afc88c2cce64 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-0695399a-1118-4302-b9d4-6167dd49c143 req-cbcba325-536f-461f-8d9e-afc88c2cce64 service nova] Creating event network-changed:02e84e5e-7d3e-4135-93fb-49791bf9f3f1 for instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 on user Apr 19 13:57:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-0695399a-1118-4302-b9d4-6167dd49c143 req-cbcba325-536f-461f-8d9e-afc88c2cce64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065135 Apr 19 13:57:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-24c24d4f-496a-448e-8668-13c2aba211c6 tempest-TestShelveInstance-1101965331 tempest-TestShelveInstance-1101965331-project-member] Calling method '.version_select at 0x7f60def6fc70>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-24c24d4f-496a-448e-8668-13c2aba211c6 tempest-TestShelveInstance-1101965331 tempest-TestShelveInstance-1101965331-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-81536929" status: 202 len: 0 microversion: 2.1 time: 0.034588 Apr 19 13:57:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 26/78] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 13:57:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-81536929 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 13:57:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-216681046", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "networks": [{"uuid": "6b06bfe4-942c-453a-af17-cdacc4c2e704"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:18 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] validate_networks() for [('6b06bfe4-942c-453a-af17-cdacc4c2e704', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Getting quotas for project 806255a694c7446893131ff6de13c42d. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Getting quotas for user 9bb00927681348c08cabf5cea1edaac2 and project 806255a694c7446893131ff6de13c42d. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:57:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-4b1131c1-f793-46cf-8456-5640a4350b9e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.567213 Apr 19 13:57:20 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 27/79] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 13:57:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 13:57:20 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-080226ac-793c-4c50-a53e-196441f76fae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:20 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-080226ac-793c-4c50-a53e-196441f76fae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:57:20 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-080226ac-793c-4c50-a53e-196441f76fae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb00927681348c08cabf5cea1edaac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806255a694c7446893131ff6de13c42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-080226ac-793c-4c50-a53e-196441f76fae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452" status: 200 len: 1210 microversion: 2.1 time: 0.132724 Apr 19 13:57:20 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 27/80] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:57:20 2023] GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452 => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:57:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-5f080845-78cb-4c97-a77d-11422be371e9 req-a59512f6-d6cc-42aa-84c8-305cc042cfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33751f45-cd9e-4b2c-ad4d-1049db7ef555", "name": "network-vif-plugged", "status": "completed", "tag": "02e84e5e-7d3e-4135-93fb-49791bf9f3f1"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5f080845-78cb-4c97-a77d-11422be371e9 req-a59512f6-d6cc-42aa-84c8-305cc042cfb1 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5f080845-78cb-4c97-a77d-11422be371e9 req-a59512f6-d6cc-42aa-84c8-305cc042cfb1 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5f080845-78cb-4c97-a77d-11422be371e9 req-a59512f6-d6cc-42aa-84c8-305cc042cfb1 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-5f080845-78cb-4c97-a77d-11422be371e9 req-a59512f6-d6cc-42aa-84c8-305cc042cfb1 service nova] Creating event network-vif-plugged:02e84e5e-7d3e-4135-93fb-49791bf9f3f1 for instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 on user Apr 19 13:57:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-5f080845-78cb-4c97-a77d-11422be371e9 req-a59512f6-d6cc-42aa-84c8-305cc042cfb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098059 Apr 19 13:57:20 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3095bad4-90d5-49b7-9b13-4c75ab012aea tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-3095bad4-90d5-49b7-9b13-4c75ab012aea tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] [instance: df6a7f5d-e8d6-4a01-90e4-6869692de6b7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3095bad4-90d5-49b7-9b13-4c75ab012aea tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3095bad4-90d5-49b7-9b13-4c75ab012aea tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3095bad4-90d5-49b7-9b13-4c75ab012aea tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3095bad4-90d5-49b7-9b13-4c75ab012aea tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3095bad4-90d5-49b7-9b13-4c75ab012aea tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3095bad4-90d5-49b7-9b13-4c75ab012aea tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:21 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-3095bad4-90d5-49b7-9b13-4c75ab012aea tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6005f003a23749bd9b9b00c87dec971c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9b8f883c474db9a4e766b9262f4217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:21 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-3095bad4-90d5-49b7-9b13-4c75ab012aea tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7" status: 200 len: 1489 microversion: 2.1 time: 0.526699 Apr 19 13:57:21 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 28/82] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:57:20 2023] GET /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7 => generated 1489 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:57:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:21 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:57:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:22 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:22 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0cd8bc9e-3b3d-4444-8810-c88818211584 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Action: 'create', calling method: .version_select at 0x7f60def6fc70>, body: {"keypair": {"name": "tempest-keypair-707300721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVZzw7B+QQkFgjl1ku3+QfvhjiBoWHZQocm4LfZnACH4fDbE+L23Qr/jXgVHWdxrfP7ecVyV27bE9FcCegQvk6xlL/BoeY2OA80wHV3vYYajqGqwol/fOZbnYZgcwda/Q=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:22 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-0cd8bc9e-3b3d-4444-8810-c88818211584 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for project 0606afa926de4400819fac2cce6813a7. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:57:22 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-0cd8bc9e-3b3d-4444-8810-c88818211584 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for user 390686e4c10c40f0b1df9b2ba9557484 and project 0606afa926de4400819fac2cce6813a7. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:57:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0cd8bc9e-3b3d-4444-8810-c88818211584 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.322707 Apr 19 13:57:22 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 28/83] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 13:57:22 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-1715e65d-7e95-402c-b34a-cb228ad90350 req-9d04b31f-4148-48d6-9dce-a26b4ebbb6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33751f45-cd9e-4b2c-ad4d-1049db7ef555", "name": "network-vif-plugged", "status": "completed", "tag": "02e84e5e-7d3e-4135-93fb-49791bf9f3f1"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1715e65d-7e95-402c-b34a-cb228ad90350 req-9d04b31f-4148-48d6-9dce-a26b4ebbb6a2 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1715e65d-7e95-402c-b34a-cb228ad90350 req-9d04b31f-4148-48d6-9dce-a26b4ebbb6a2 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1715e65d-7e95-402c-b34a-cb228ad90350 req-9d04b31f-4148-48d6-9dce-a26b4ebbb6a2 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1715e65d-7e95-402c-b34a-cb228ad90350 req-9d04b31f-4148-48d6-9dce-a26b4ebbb6a2 service nova] Creating event network-vif-plugged:02e84e5e-7d3e-4135-93fb-49791bf9f3f1 for instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 on user Apr 19 13:57:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-1715e65d-7e95-402c-b34a-cb228ad90350 req-9d04b31f-4148-48d6-9dce-a26b4ebbb6a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036290 Apr 19 13:57:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 29/84] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6223894c-a31a-4f03-8c9c-1fb965e5f213 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:23 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6223894c-a31a-4f03-8c9c-1fb965e5f213 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:57:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6223894c-a31a-4f03-8c9c-1fb965e5f213 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6223894c-a31a-4f03-8c9c-1fb965e5f213 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6223894c-a31a-4f03-8c9c-1fb965e5f213 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6223894c-a31a-4f03-8c9c-1fb965e5f213 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6223894c-a31a-4f03-8c9c-1fb965e5f213 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6223894c-a31a-4f03-8c9c-1fb965e5f213 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:23 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-6223894c-a31a-4f03-8c9c-1fb965e5f213 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3a097ff4d04a0287c417b23d3b00e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f754b42ccea544d4a34e986a6119db51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6223894c-a31a-4f03-8c9c-1fb965e5f213 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f" status: 200 len: 1551 microversion: 2.1 time: 0.438554 Apr 19 13:57:23 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 29/85] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:57:23 2023] GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f => generated 1551 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:57:23 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:23 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:23 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7fd14306-33f1-4a28-84f7-07c35d2673d5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b" status: 200 len: 1585 microversion: 2.20 time: 2.229423 Apr 19 13:57:23 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 28/86] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 13:57:21 2023] GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b => generated 1585 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 13:57:24 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1527188231", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "eccb12ee-eec2-46f3-bd4b-50363e787f6e"}], "security_groups": [{"name": "tempest-securitygroup--1635092002"}], "key_name": "tempest-keypair-707300721", "user_data": "}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:24 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] validate_networks() for [('eccb12ee-eec2-46f3-bd4b-50363e787f6e', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=19 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for project 0606afa926de4400819fac2cce6813a7. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for user 390686e4c10c40f0b1df9b2ba9557484 and project 0606afa926de4400819fac2cce6813a7. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:57:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:57:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-23d00250-7d7d-4c82-972b-cb579831edd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.351195 Apr 19 13:57:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 30/87] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 13:57:24 2023] POST /compute/v2.1/servers => generated 400 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 13:57:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e599aff7-1a6b-49c0-8c6b-fa826ba91cf9 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:25 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e599aff7-1a6b-49c0-8c6b-fa826ba91cf9 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:57:25 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:25 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-e599aff7-1a6b-49c0-8c6b-fa826ba91cf9 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390686e4c10c40f0b1df9b2ba9557484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606afa926de4400819fac2cce6813a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e599aff7-1a6b-49c0-8c6b-fa826ba91cf9 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759" status: 200 len: 1235 microversion: 2.1 time: 0.093063 Apr 19 13:57:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 30/88] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:57:25 2023] GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759 => generated 1235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:57:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-08413780-a1e0-4e07-a725-41d4fc950d1e req-701cce75-2c30-4da0-8300-ae48977af838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce0b5c9-a197-4697-ba7a-cba87012c452", "tag": "07fb6250-2dfa-4106-889e-7601e4bdd4a3"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:26 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-08413780-a1e0-4e07-a725-41d4fc950d1e req-701cce75-2c30-4da0-8300-ae48977af838 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-08413780-a1e0-4e07-a725-41d4fc950d1e req-701cce75-2c30-4da0-8300-ae48977af838 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-08413780-a1e0-4e07-a725-41d4fc950d1e req-701cce75-2c30-4da0-8300-ae48977af838 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-08413780-a1e0-4e07-a725-41d4fc950d1e req-701cce75-2c30-4da0-8300-ae48977af838 service nova] Creating event network-changed:07fb6250-2dfa-4106-889e-7601e4bdd4a3 for instance dce0b5c9-a197-4697-ba7a-cba87012c452 on user Apr 19 13:57:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-08413780-a1e0-4e07-a725-41d4fc950d1e req-701cce75-2c30-4da0-8300-ae48977af838 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051843 Apr 19 13:57:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 29/89] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-938876811", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "networks": [{"uuid": "6c5edc8e-b8c1-4e48-bd8d-acf10a103739"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:27 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] validate_networks() for [('6c5edc8e-b8c1-4e48-bd8d-acf10a103739', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Getting quotas for project 2bf567425cb7480e93f114268dc22713. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Getting quotas for user 46f11c11cc4f46e3810f06e974a387c8 and project 2bf567425cb7480e93f114268dc22713. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:57:28 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 7dd44282-31f1-44b8-a8a4-9c7556736201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:57:28 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-dc888a36-5433-4fc9-b689-ead475997a89 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.933384 Apr 19 13:57:28 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 31/90] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 13:57:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 13:57:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6e493207-c5b5-4ab5-9c4b-2166afacb0e8 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:28 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6e493207-c5b5-4ab5-9c4b-2166afacb0e8 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 7dd44282-31f1-44b8-a8a4-9c7556736201] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:57:28 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-6e493207-c5b5-4ab5-9c4b-2166afacb0e8 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:28 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-6e493207-c5b5-4ab5-9c4b-2166afacb0e8 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:28 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-6e493207-c5b5-4ab5-9c4b-2166afacb0e8 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6e493207-c5b5-4ab5-9c4b-2166afacb0e8 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201" status: 200 len: 1394 microversion: 2.87 time: 0.112422 Apr 19 13:57:28 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 31/91] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 13:57:28 2023] GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201 => generated 1394 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 13:57:29 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-dfdda3ce-6d28-4937-8376-79b44fb13045 req-ffe35c5a-a4f5-4030-8f5e-02c8adda7408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce0b5c9-a197-4697-ba7a-cba87012c452", "name": "network-vif-plugged", "status": "completed", "tag": "07fb6250-2dfa-4106-889e-7601e4bdd4a3"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dfdda3ce-6d28-4937-8376-79b44fb13045 req-ffe35c5a-a4f5-4030-8f5e-02c8adda7408 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dfdda3ce-6d28-4937-8376-79b44fb13045 req-ffe35c5a-a4f5-4030-8f5e-02c8adda7408 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-dfdda3ce-6d28-4937-8376-79b44fb13045 req-ffe35c5a-a4f5-4030-8f5e-02c8adda7408 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-dfdda3ce-6d28-4937-8376-79b44fb13045 req-ffe35c5a-a4f5-4030-8f5e-02c8adda7408 service nova] Creating event network-vif-plugged:07fb6250-2dfa-4106-889e-7601e4bdd4a3 for instance dce0b5c9-a197-4697-ba7a-cba87012c452 on user Apr 19 13:57:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-dfdda3ce-6d28-4937-8376-79b44fb13045 req-ffe35c5a-a4f5-4030-8f5e-02c8adda7408 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067816 Apr 19 13:57:30 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 30/92] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-2929281c-ac1f-4243-b4d1-5938f3ff64e5 req-c749d13f-73df-4570-9b6f-b724a1d8e74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c98d2742-2a0f-4004-b3ad-bd387ed40759", "tag": "b595825e-f064-493e-be6d-78cfb50a387a"}, {"server_uuid": "dce0b5c9-a197-4697-ba7a-cba87012c452", "name": "network-vif-plugged", "status": "completed", "tag": "07fb6250-2dfa-4106-889e-7601e4bdd4a3"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:32 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=12 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2929281c-ac1f-4243-b4d1-5938f3ff64e5 req-c749d13f-73df-4570-9b6f-b724a1d8e74a service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2929281c-ac1f-4243-b4d1-5938f3ff64e5 req-c749d13f-73df-4570-9b6f-b724a1d8e74a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:32 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-2929281c-ac1f-4243-b4d1-5938f3ff64e5 req-c749d13f-73df-4570-9b6f-b724a1d8e74a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-2929281c-ac1f-4243-b4d1-5938f3ff64e5 req-c749d13f-73df-4570-9b6f-b724a1d8e74a service nova] Creating event network-changed:b595825e-f064-493e-be6d-78cfb50a387a for instance c98d2742-2a0f-4004-b3ad-bd387ed40759 on user Apr 19 13:57:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-2929281c-ac1f-4243-b4d1-5938f3ff64e5 req-c749d13f-73df-4570-9b6f-b724a1d8e74a service nova] Creating event network-vif-plugged:07fb6250-2dfa-4106-889e-7601e4bdd4a3 for instance dce0b5c9-a197-4697-ba7a-cba87012c452 on user Apr 19 13:57:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-2929281c-ac1f-4243-b4d1-5938f3ff64e5 req-c749d13f-73df-4570-9b6f-b724a1d8e74a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061074 Apr 19 13:57:32 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 32/93] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:32 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:33 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-2bbdda1e-1b25-4241-a363-6d9d31d563d0 req-06dac8e0-38a1-4c71-a410-e38e49963c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98d2742-2a0f-4004-b3ad-bd387ed40759", "name": "network-vif-plugged", "status": "completed", "tag": "b595825e-f064-493e-be6d-78cfb50a387a"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:33 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=18 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-2bbdda1e-1b25-4241-a363-6d9d31d563d0 req-06dac8e0-38a1-4c71-a410-e38e49963c2a service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-2bbdda1e-1b25-4241-a363-6d9d31d563d0 req-06dac8e0-38a1-4c71-a410-e38e49963c2a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-2bbdda1e-1b25-4241-a363-6d9d31d563d0 req-06dac8e0-38a1-4c71-a410-e38e49963c2a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-2bbdda1e-1b25-4241-a363-6d9d31d563d0 req-06dac8e0-38a1-4c71-a410-e38e49963c2a service nova] Creating event network-vif-plugged:b595825e-f064-493e-be6d-78cfb50a387a for instance c98d2742-2a0f-4004-b3ad-bd387ed40759 on user Apr 19 13:57:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-2bbdda1e-1b25-4241-a363-6d9d31d563d0 req-06dac8e0-38a1-4c71-a410-e38e49963c2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091831 Apr 19 13:57:33 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 32/94] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:34 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=14 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:34 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-68198cdf-0f88-4639-bb0b-eb3ecfc4d3ac req-5b6cb810-40c9-4ede-9179-b69f6886cb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd44282-31f1-44b8-a8a4-9c7556736201", "tag": "df9c278d-65ca-4d17-aa68-89dde294a441"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-68198cdf-0f88-4639-bb0b-eb3ecfc4d3ac req-5b6cb810-40c9-4ede-9179-b69f6886cb78 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-68198cdf-0f88-4639-bb0b-eb3ecfc4d3ac req-5b6cb810-40c9-4ede-9179-b69f6886cb78 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:34 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-68198cdf-0f88-4639-bb0b-eb3ecfc4d3ac req-5b6cb810-40c9-4ede-9179-b69f6886cb78 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-68198cdf-0f88-4639-bb0b-eb3ecfc4d3ac req-5b6cb810-40c9-4ede-9179-b69f6886cb78 service nova] Creating event network-changed:df9c278d-65ca-4d17-aa68-89dde294a441 for instance 7dd44282-31f1-44b8-a8a4-9c7556736201 on user Apr 19 13:57:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-68198cdf-0f88-4639-bb0b-eb3ecfc4d3ac req-5b6cb810-40c9-4ede-9179-b69f6886cb78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034261 Apr 19 13:57:34 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:35 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-e8eae30f-10b1-462a-a25c-0deeb2439c06 req-e9eb4b4d-460e-4eb8-b813-46931fae809c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98d2742-2a0f-4004-b3ad-bd387ed40759", "name": "network-vif-plugged", "status": "completed", "tag": "b595825e-f064-493e-be6d-78cfb50a387a"}, {"server_uuid": "7dd44282-31f1-44b8-a8a4-9c7556736201", "name": "network-vif-plugged", "status": "completed", "tag": "df9c278d-65ca-4d17-aa68-89dde294a441"}, {"server_uuid": "7dd44282-31f1-44b8-a8a4-9c7556736201", "name": "network-vif-plugged", "status": "completed", "tag": "df9c278d-65ca-4d17-aa68-89dde294a441"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e8eae30f-10b1-462a-a25c-0deeb2439c06 req-e9eb4b4d-460e-4eb8-b813-46931fae809c service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e8eae30f-10b1-462a-a25c-0deeb2439c06 req-e9eb4b4d-460e-4eb8-b813-46931fae809c service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e8eae30f-10b1-462a-a25c-0deeb2439c06 req-e9eb4b4d-460e-4eb8-b813-46931fae809c service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-e8eae30f-10b1-462a-a25c-0deeb2439c06 req-e9eb4b4d-460e-4eb8-b813-46931fae809c service nova] Creating event network-vif-plugged:b595825e-f064-493e-be6d-78cfb50a387a for instance c98d2742-2a0f-4004-b3ad-bd387ed40759 on user Apr 19 13:57:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-e8eae30f-10b1-462a-a25c-0deeb2439c06 req-e9eb4b4d-460e-4eb8-b813-46931fae809c service nova] Creating event network-vif-plugged:df9c278d-65ca-4d17-aa68-89dde294a441 for instance 7dd44282-31f1-44b8-a8a4-9c7556736201 on user Apr 19 13:57:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-e8eae30f-10b1-462a-a25c-0deeb2439c06 req-e9eb4b4d-460e-4eb8-b813-46931fae809c service nova] Creating event network-vif-plugged:df9c278d-65ca-4d17-aa68-89dde294a441 for instance 7dd44282-31f1-44b8-a8a4-9c7556736201 on user Apr 19 13:57:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-e8eae30f-10b1-462a-a25c-0deeb2439c06 req-e9eb4b4d-460e-4eb8-b813-46931fae809c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.180871 Apr 19 13:57:35 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:57:35 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:57:39 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:39 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-dcf3e8df-08b6-42c1-944c-314f3d99c20e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:39 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-dcf3e8df-08b6-42c1-944c-314f3d99c20e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: dee689b0-177a-4265-a296-c75cd57e74ba] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:57:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dcf3e8df-08b6-42c1-944c-314f3d99c20e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dcf3e8df-08b6-42c1-944c-314f3d99c20e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dcf3e8df-08b6-42c1-944c-314f3d99c20e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dcf3e8df-08b6-42c1-944c-314f3d99c20e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dcf3e8df-08b6-42c1-944c-314f3d99c20e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dcf3e8df-08b6-42c1-944c-314f3d99c20e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:39 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-dcf3e8df-08b6-42c1-944c-314f3d99c20e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0088ff4bd64218b490c3414afb1c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b882fb2e40e74c88a69342ca2385b28f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-dcf3e8df-08b6-42c1-944c-314f3d99c20e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba" status: 200 len: 1544 microversion: 2.1 time: 0.392706 Apr 19 13:57:39 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 33/97] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:57:39 2023] GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba => generated 1544 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=5 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=14 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-40e1a169-66b2-4b5c-a2b0-7285702854a8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-40e1a169-66b2-4b5c-a2b0-7285702854a8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] [instance: 0b41bbd3-cf76-4be0-8d76-c22496a7fe23] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-40e1a169-66b2-4b5c-a2b0-7285702854a8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-40e1a169-66b2-4b5c-a2b0-7285702854a8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-40e1a169-66b2-4b5c-a2b0-7285702854a8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-40e1a169-66b2-4b5c-a2b0-7285702854a8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-40e1a169-66b2-4b5c-a2b0-7285702854a8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-40e1a169-66b2-4b5c-a2b0-7285702854a8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:57:53 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-40e1a169-66b2-4b5c-a2b0-7285702854a8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd0c03d870041c58e7a857d65e066cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dfe1cb247c4e68bd5dbbe1ccce3100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:57:53 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-40e1a169-66b2-4b5c-a2b0-7285702854a8 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23" status: 200 len: 1549 microversion: 2.1 time: 0.315048 Apr 19 13:57:53 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 32/98] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:57:53 2023] GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23 => generated 1549 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:57:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=11 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=22 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:57:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-36af042d-bd7b-4d18-90a8-ff39a9d818dc tempest-TestVolumeBootPattern-258041549 tempest-TestVolumeBootPattern-258041549-project-member] Action: 'create', calling method: .version_select at 0x7f60de6145e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1646767956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOiOlZoLuk7lStnSnpLRfgwdYFQfpIRuSiIZiNdKvzVIAI3WGLaRGFkFPYrGjR+n0idczAITeeo5ZlKInBwYccznPdkxoQiC72uVOQmfT/ImPd+s3Hdj+u4RQ6ycGjoQg=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:57:58 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-36af042d-bd7b-4d18-90a8-ff39a9d818dc tempest-TestVolumeBootPattern-258041549 tempest-TestVolumeBootPattern-258041549-project-member] Getting quotas for project 0b170866259442f688800f6381367bcb. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:57:58 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-36af042d-bd7b-4d18-90a8-ff39a9d818dc tempest-TestVolumeBootPattern-258041549 tempest-TestVolumeBootPattern-258041549-project-member] Getting quotas for user 82c2ab0a573a44a78fdbb9562649f8f2 and project 0b170866259442f688800f6381367bcb. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:57:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-36af042d-bd7b-4d18-90a8-ff39a9d818dc tempest-TestVolumeBootPattern-258041549 tempest-TestVolumeBootPattern-258041549-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.064946 Apr 19 13:57:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 34/99] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 13:57:58 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-81daf785-bd43-4a7c-9915-8802472f1c2c tempest-TestVolumeBootPattern-258041549 tempest-TestVolumeBootPattern-258041549-project-member] Calling method '.version_select at 0x7f60defbda20>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:01 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=13 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:01 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=8 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-81daf785-bd43-4a7c-9915-8802472f1c2c tempest-TestVolumeBootPattern-258041549 tempest-TestVolumeBootPattern-258041549-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1646767956" status: 202 len: 0 microversion: 2.1 time: 0.035324 Apr 19 13:58:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 34/100] 10.0.0.210 () {62 vars in 1340 bytes} [Wed Apr 19 13:58:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1646767956 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 13:58:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d03af48d-c029-4382-bb23-c29e0a22ea4f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d03af48d-c029-4382-bb23-c29e0a22ea4f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 33751f45-cd9e-4b2c-ad4d-1049db7ef555] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d03af48d-c029-4382-bb23-c29e0a22ea4f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d03af48d-c029-4382-bb23-c29e0a22ea4f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d03af48d-c029-4382-bb23-c29e0a22ea4f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d03af48d-c029-4382-bb23-c29e0a22ea4f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d03af48d-c029-4382-bb23-c29e0a22ea4f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d03af48d-c029-4382-bb23-c29e0a22ea4f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:02 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-d03af48d-c029-4382-bb23-c29e0a22ea4f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d03af48d-c029-4382-bb23-c29e0a22ea4f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555" status: 200 len: 1538 microversion: 2.1 time: 0.253544 Apr 19 13:58:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 33/101] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:58:02 2023] GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555 => generated 1538 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-752eb235-2c37-4130-b41c-c693b7e6761f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-752eb235-2c37-4130-b41c-c693b7e6761f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-752eb235-2c37-4130-b41c-c693b7e6761f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-752eb235-2c37-4130-b41c-c693b7e6761f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-752eb235-2c37-4130-b41c-c693b7e6761f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-752eb235-2c37-4130-b41c-c693b7e6761f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-752eb235-2c37-4130-b41c-c693b7e6761f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-752eb235-2c37-4130-b41c-c693b7e6761f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:10 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-752eb235-2c37-4130-b41c-c693b7e6761f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb00927681348c08cabf5cea1edaac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806255a694c7446893131ff6de13c42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:10 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-752eb235-2c37-4130-b41c-c693b7e6761f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452" status: 200 len: 1493 microversion: 2.1 time: 0.226110 Apr 19 13:58:10 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 35/102] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:58:10 2023] GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452 => generated 1493 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:58:15 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-7082a46f-7424-4af1-b3a5-3df57c63153d tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7082a46f-7424-4af1-b3a5-3df57c63153d tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7082a46f-7424-4af1-b3a5-3df57c63153d tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7082a46f-7424-4af1-b3a5-3df57c63153d tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7082a46f-7424-4af1-b3a5-3df57c63153d tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7082a46f-7424-4af1-b3a5-3df57c63153d tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7082a46f-7424-4af1-b3a5-3df57c63153d tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7082a46f-7424-4af1-b3a5-3df57c63153d tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:15 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-7082a46f-7424-4af1-b3a5-3df57c63153d tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390686e4c10c40f0b1df9b2ba9557484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606afa926de4400819fac2cce6813a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-7082a46f-7424-4af1-b3a5-3df57c63153d tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759" status: 200 len: 1544 microversion: 2.1 time: 0.218791 Apr 19 13:58:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 35/103] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:58:15 2023] GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759 => generated 1544 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=12 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 7dd44282-31f1-44b8-a8a4-9c7556736201] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:18 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-9c48a7ff-0c45-495b-b4aa-e27bc4388cfc tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201" status: 200 len: 1689 microversion: 2.87 time: 0.326393 Apr 19 13:58:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 34/104] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 13:58:18 2023] GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201 => generated 1689 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8b8f4d8a-aea8-4d0e-b67a-dc7fd78a888f tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8b8f4d8a-aea8-4d0e-b67a-dc7fd78a888f tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] [instance: df6a7f5d-e8d6-4a01-90e4-6869692de6b7] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b8f4d8a-aea8-4d0e-b67a-dc7fd78a888f tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b8f4d8a-aea8-4d0e-b67a-dc7fd78a888f tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b8f4d8a-aea8-4d0e-b67a-dc7fd78a888f tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b8f4d8a-aea8-4d0e-b67a-dc7fd78a888f tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b8f4d8a-aea8-4d0e-b67a-dc7fd78a888f tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8b8f4d8a-aea8-4d0e-b67a-dc7fd78a888f tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:22 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8b8f4d8a-aea8-4d0e-b67a-dc7fd78a888f tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] [instance: df6a7f5d-e8d6-4a01-90e4-6869692de6b7] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 13:58:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8b8f4d8a-aea8-4d0e-b67a-dc7fd78a888f tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7" status: 204 len: 0 microversion: 2.1 time: 0.170768 Apr 19 13:58:23 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 36/105] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 13:58:22 2023] DELETE /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-09e375f4-9fd4-400b-b009-f9ac6bd2eb8b tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-09e375f4-9fd4-400b-b009-f9ac6bd2eb8b tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] [instance: df6a7f5d-e8d6-4a01-90e4-6869692de6b7] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09e375f4-9fd4-400b-b009-f9ac6bd2eb8b tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09e375f4-9fd4-400b-b009-f9ac6bd2eb8b tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09e375f4-9fd4-400b-b009-f9ac6bd2eb8b tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09e375f4-9fd4-400b-b009-f9ac6bd2eb8b tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09e375f4-9fd4-400b-b009-f9ac6bd2eb8b tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09e375f4-9fd4-400b-b009-f9ac6bd2eb8b tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-09e375f4-9fd4-400b-b009-f9ac6bd2eb8b tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6005f003a23749bd9b9b00c87dec971c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9b8f883c474db9a4e766b9262f4217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-09e375f4-9fd4-400b-b009-f9ac6bd2eb8b tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7" status: 200 len: 1495 microversion: 2.1 time: 0.240387 Apr 19 13:58:23 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 36/106] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:58:23 2023] GET /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7 => generated 1495 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:58:23 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-b3374df7-739e-48fc-b90b-bd413bce3bea req-1857ab3e-fc6a-46a4-9bbb-f6727272d85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6a7f5d-e8d6-4a01-90e4-6869692de6b7", "name": "network-vif-unplugged", "status": "completed", "tag": "c8a25e67-fccb-4889-b460-c9843a2e232d"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b3374df7-739e-48fc-b90b-bd413bce3bea req-1857ab3e-fc6a-46a4-9bbb-f6727272d85a service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b3374df7-739e-48fc-b90b-bd413bce3bea req-1857ab3e-fc6a-46a4-9bbb-f6727272d85a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:23 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b3374df7-739e-48fc-b90b-bd413bce3bea req-1857ab3e-fc6a-46a4-9bbb-f6727272d85a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-b3374df7-739e-48fc-b90b-bd413bce3bea req-1857ab3e-fc6a-46a4-9bbb-f6727272d85a service nova] Creating event network-vif-unplugged:c8a25e67-fccb-4889-b460-c9843a2e232d for instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 on user Apr 19 13:58:23 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-b3374df7-739e-48fc-b90b-bd413bce3bea req-1857ab3e-fc6a-46a4-9bbb-f6727272d85a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027735 Apr 19 13:58:23 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 35/107] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:23 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5c6f8226-2ff4-4d6a-933a-4d293190860d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:23 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5c6f8226-2ff4-4d6a-933a-4d293190860d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c6f8226-2ff4-4d6a-933a-4d293190860d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c6f8226-2ff4-4d6a-933a-4d293190860d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c6f8226-2ff4-4d6a-933a-4d293190860d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c6f8226-2ff4-4d6a-933a-4d293190860d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c6f8226-2ff4-4d6a-933a-4d293190860d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:23 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5c6f8226-2ff4-4d6a-933a-4d293190860d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:23 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5c6f8226-2ff4-4d6a-933a-4d293190860d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.165481 Apr 19 13:58:23 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 37/108] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 13:58:23 2023] GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f/os-interface => generated 282 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-15f17ea2-4b8f-4a38-ae24-290791c54829 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-15f17ea2-4b8f-4a38-ae24-290791c54829 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f17ea2-4b8f-4a38-ae24-290791c54829 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f17ea2-4b8f-4a38-ae24-290791c54829 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f17ea2-4b8f-4a38-ae24-290791c54829 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f17ea2-4b8f-4a38-ae24-290791c54829 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f17ea2-4b8f-4a38-ae24-290791c54829 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-15f17ea2-4b8f-4a38-ae24-290791c54829 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-15f17ea2-4b8f-4a38-ae24-290791c54829 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.194698 Apr 19 13:58:24 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 37/109] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 19 13:58:23 2023] GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b/os-interface => generated 282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-5c7b2f76-b122-414b-a335-91582a475d78 req-6ba4e3af-2868-4714-8777-ea602b221fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5c7b2f76-b122-414b-a335-91582a475d78 req-6ba4e3af-2868-4714-8777-ea602b221fea service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5c7b2f76-b122-414b-a335-91582a475d78 req-6ba4e3af-2868-4714-8777-ea602b221fea service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-5c7b2f76-b122-414b-a335-91582a475d78 req-6ba4e3af-2868-4714-8777-ea602b221fea service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-5c7b2f76-b122-414b-a335-91582a475d78 req-6ba4e3af-2868-4714-8777-ea602b221fea service nova] Creating event network-changed:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 13:58:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-5c7b2f76-b122-414b-a335-91582a475d78 req-6ba4e3af-2868-4714-8777-ea602b221fea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039997 Apr 19 13:58:25 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 36/110] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:25 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-10c95cc0-8e6e-4ae4-ada1-42979981f45b tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1941763848"}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-10c95cc0-8e6e-4ae4-ada1-42979981f45b tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-10c95cc0-8e6e-4ae4-ada1-42979981f45b tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-10c95cc0-8e6e-4ae4-ada1-42979981f45b tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-10c95cc0-8e6e-4ae4-ada1-42979981f45b tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-10c95cc0-8e6e-4ae4-ada1-42979981f45b tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-10c95cc0-8e6e-4ae4-ada1-42979981f45b tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-10c95cc0-8e6e-4ae4-ada1-42979981f45b tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-d45679e6-c8ee-40d1-8134-73fc9fa5aa0d req-dcf9e442-1cd4-4409-ad76-a356511409c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c95eb6-9d18-41fa-b334-0c423a01241b", "tag": "dd69fbb4-0eaf-4284-b851-00660dd803c4"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d45679e6-c8ee-40d1-8134-73fc9fa5aa0d req-dcf9e442-1cd4-4409-ad76-a356511409c5 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d45679e6-c8ee-40d1-8134-73fc9fa5aa0d req-dcf9e442-1cd4-4409-ad76-a356511409c5 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d45679e6-c8ee-40d1-8134-73fc9fa5aa0d req-dcf9e442-1cd4-4409-ad76-a356511409c5 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-d45679e6-c8ee-40d1-8134-73fc9fa5aa0d req-dcf9e442-1cd4-4409-ad76-a356511409c5 service nova] Creating event network-changed:dd69fbb4-0eaf-4284-b851-00660dd803c4 for instance 20c95eb6-9d18-41fa-b334-0c423a01241b on user Apr 19 13:58:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-d45679e6-c8ee-40d1-8134-73fc9fa5aa0d req-dcf9e442-1cd4-4409-ad76-a356511409c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037815 Apr 19 13:58:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 38/111] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-6b009a63-e89e-4fe0-9210-4d899370f08d tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-6b009a63-e89e-4fe0-9210-4d899370f08d tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b009a63-e89e-4fe0-9210-4d899370f08d tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b009a63-e89e-4fe0-9210-4d899370f08d tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b009a63-e89e-4fe0-9210-4d899370f08d tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b009a63-e89e-4fe0-9210-4d899370f08d tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b009a63-e89e-4fe0-9210-4d899370f08d tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6b009a63-e89e-4fe0-9210-4d899370f08d tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a11e6bde-b766-43d7-88df-6d4e9a39a14a req-2a113b73-4808-4fa7-8dce-63393f9c53b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6a7f5d-e8d6-4a01-90e4-6869692de6b7", "name": "network-vif-plugged", "status": "completed", "tag": "c8a25e67-fccb-4889-b460-c9843a2e232d"}, {"server_uuid": "df6a7f5d-e8d6-4a01-90e4-6869692de6b7", "name": "network-vif-deleted", "tag": "c8a25e67-fccb-4889-b460-c9843a2e232d"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a11e6bde-b766-43d7-88df-6d4e9a39a14a req-2a113b73-4808-4fa7-8dce-63393f9c53b8 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a11e6bde-b766-43d7-88df-6d4e9a39a14a req-2a113b73-4808-4fa7-8dce-63393f9c53b8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a11e6bde-b766-43d7-88df-6d4e9a39a14a req-2a113b73-4808-4fa7-8dce-63393f9c53b8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a11e6bde-b766-43d7-88df-6d4e9a39a14a req-2a113b73-4808-4fa7-8dce-63393f9c53b8 service nova] Creating event network-vif-plugged:c8a25e67-fccb-4889-b460-c9843a2e232d for instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 on user Apr 19 13:58:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a11e6bde-b766-43d7-88df-6d4e9a39a14a req-2a113b73-4808-4fa7-8dce-63393f9c53b8 service nova] Creating event network-vif-deleted:c8a25e67-fccb-4889-b460-c9843a2e232d for instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 on user Apr 19 13:58:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a11e6bde-b766-43d7-88df-6d4e9a39a14a req-2a113b73-4808-4fa7-8dce-63393f9c53b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034131 Apr 19 13:58:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 39/112] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-6b009a63-e89e-4fe0-9210-4d899370f08d tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b/ips" status: 200 len: 108 microversion: 2.20 time: 0.072217 Apr 19 13:58:25 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 37/113] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 19 13:58:25 2023] GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b/ips => generated 108 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 13:58:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-10c95cc0-8e6e-4ae4-ada1-42979981f45b tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f/action" status: 202 len: 0 microversion: 2.1 time: 1.223158 Apr 19 13:58:26 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 38/114] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 19 13:58:25 2023] POST /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f/action => generated 0 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 19 13:58:26 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3936f25d-b903-4ae4-8bb8-22f6c8da7cb4 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '.version_select at 0x7f60defbda20>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:26 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3936f25d-b903-4ae4-8bb8-22f6c8da7cb4 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "GET /compute/v2.1/images/b1a1059c-a29c-435a-aaff-8993a28bfc9d" status: 200 len: 1609 microversion: 2.1 time: 0.054532 Apr 19 13:58:26 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 40/115] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 13:58:26 2023] GET /compute/v2.1/images/b1a1059c-a29c-435a-aaff-8993a28bfc9d => generated 1609 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:58:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-739a5824-cd8a-409d-ad3b-325a4f1a3005 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:26 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-739a5824-cd8a-409d-ad3b-325a4f1a3005 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-739a5824-cd8a-409d-ad3b-325a4f1a3005 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-739a5824-cd8a-409d-ad3b-325a4f1a3005 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-739a5824-cd8a-409d-ad3b-325a4f1a3005 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-739a5824-cd8a-409d-ad3b-325a4f1a3005 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-739a5824-cd8a-409d-ad3b-325a4f1a3005 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-739a5824-cd8a-409d-ad3b-325a4f1a3005 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:26 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-739a5824-cd8a-409d-ad3b-325a4f1a3005 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 13:58:27 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-739a5824-cd8a-409d-ad3b-325a4f1a3005 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b" status: 204 len: 0 microversion: 2.20 time: 0.338174 Apr 19 13:58:27 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 38/116] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 13:58:26 2023] DELETE /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-7885e76b-e684-4fa9-9f94-9b4896552a76 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b" status: 200 len: 1710 microversion: 2.20 time: 0.223917 Apr 19 13:58:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 39/117] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 13:58:27 2023] GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b => generated 1710 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 13:58:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-e21543f8-2b91-4179-b9dd-5c47976c2916 req-8cd18cd0-2f9c-4863-bc05-5c0e05eaf840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c95eb6-9d18-41fa-b334-0c423a01241b", "name": "network-vif-unplugged", "status": "completed", "tag": "dd69fbb4-0eaf-4284-b851-00660dd803c4"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e21543f8-2b91-4179-b9dd-5c47976c2916 req-8cd18cd0-2f9c-4863-bc05-5c0e05eaf840 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e21543f8-2b91-4179-b9dd-5c47976c2916 req-8cd18cd0-2f9c-4863-bc05-5c0e05eaf840 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e21543f8-2b91-4179-b9dd-5c47976c2916 req-8cd18cd0-2f9c-4863-bc05-5c0e05eaf840 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-e21543f8-2b91-4179-b9dd-5c47976c2916 req-8cd18cd0-2f9c-4863-bc05-5c0e05eaf840 service nova] Creating event network-vif-unplugged:dd69fbb4-0eaf-4284-b851-00660dd803c4 for instance 20c95eb6-9d18-41fa-b334-0c423a01241b on user Apr 19 13:58:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-e21543f8-2b91-4179-b9dd-5c47976c2916 req-8cd18cd0-2f9c-4863-bc05-5c0e05eaf840 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056473 Apr 19 13:58:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 41/118] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:29 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-1fa01b7b-5077-41a9-97f7-812b16381ca3 req-c345fcd0-f2c1-4ed6-adc1-ab9da8cfe1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c95eb6-9d18-41fa-b334-0c423a01241b", "name": "network-vif-plugged", "status": "completed", "tag": "dd69fbb4-0eaf-4284-b851-00660dd803c4"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1fa01b7b-5077-41a9-97f7-812b16381ca3 req-c345fcd0-f2c1-4ed6-adc1-ab9da8cfe1a4 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1fa01b7b-5077-41a9-97f7-812b16381ca3 req-c345fcd0-f2c1-4ed6-adc1-ab9da8cfe1a4 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1fa01b7b-5077-41a9-97f7-812b16381ca3 req-c345fcd0-f2c1-4ed6-adc1-ab9da8cfe1a4 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-1fa01b7b-5077-41a9-97f7-812b16381ca3 req-c345fcd0-f2c1-4ed6-adc1-ab9da8cfe1a4 service nova] Creating event network-vif-plugged:dd69fbb4-0eaf-4284-b851-00660dd803c4 for instance 20c95eb6-9d18-41fa-b334-0c423a01241b on user Apr 19 13:58:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-1fa01b7b-5077-41a9-97f7-812b16381ca3 req-c345fcd0-f2c1-4ed6-adc1-ab9da8cfe1a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034283 Apr 19 13:58:29 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-950501cf-a93c-4e2e-acf9-33defa52cb21 req-03df6acc-5065-45b9-b693-2fe5171442a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c95eb6-9d18-41fa-b334-0c423a01241b", "name": "network-vif-deleted", "tag": "dd69fbb4-0eaf-4284-b851-00660dd803c4"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-950501cf-a93c-4e2e-acf9-33defa52cb21 req-03df6acc-5065-45b9-b693-2fe5171442a1 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-950501cf-a93c-4e2e-acf9-33defa52cb21 req-03df6acc-5065-45b9-b693-2fe5171442a1 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-950501cf-a93c-4e2e-acf9-33defa52cb21 req-03df6acc-5065-45b9-b693-2fe5171442a1 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-950501cf-a93c-4e2e-acf9-33defa52cb21 req-03df6acc-5065-45b9-b693-2fe5171442a1 service nova] Creating event network-vif-deleted:dd69fbb4-0eaf-4284-b851-00660dd803c4 for instance 20c95eb6-9d18-41fa-b334-0c423a01241b on user Apr 19 13:58:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-950501cf-a93c-4e2e-acf9-33defa52cb21 req-03df6acc-5065-45b9-b693-2fe5171442a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031145 Apr 19 13:58:31 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 40/120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:39 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=12 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:39 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=22 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:39 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1bd723f6-b7eb-43ef-bce2-a221444c0f5a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:39 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1bd723f6-b7eb-43ef-bce2-a221444c0f5a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: dee689b0-177a-4265-a296-c75cd57e74ba] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1bd723f6-b7eb-43ef-bce2-a221444c0f5a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1bd723f6-b7eb-43ef-bce2-a221444c0f5a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1bd723f6-b7eb-43ef-bce2-a221444c0f5a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1bd723f6-b7eb-43ef-bce2-a221444c0f5a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1bd723f6-b7eb-43ef-bce2-a221444c0f5a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:40 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1bd723f6-b7eb-43ef-bce2-a221444c0f5a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:40 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1bd723f6-b7eb-43ef-bce2-a221444c0f5a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.195704 Apr 19 13:58:40 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 42/121] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 13:58:39 2023] GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba/os-interface => generated 282 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:41 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:41 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-e74b66e0-8e5e-4293-b8f0-ae67b005519f req-67751d4e-36ba-4552-bd18-64cffe331d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee689b0-177a-4265-a296-c75cd57e74ba", "tag": "18f0605d-b40a-40a3-9eda-f2d5c5a95867"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e74b66e0-8e5e-4293-b8f0-ae67b005519f req-67751d4e-36ba-4552-bd18-64cffe331d7c service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e74b66e0-8e5e-4293-b8f0-ae67b005519f req-67751d4e-36ba-4552-bd18-64cffe331d7c service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e74b66e0-8e5e-4293-b8f0-ae67b005519f req-67751d4e-36ba-4552-bd18-64cffe331d7c service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-e74b66e0-8e5e-4293-b8f0-ae67b005519f req-67751d4e-36ba-4552-bd18-64cffe331d7c service nova] Creating event network-changed:18f0605d-b40a-40a3-9eda-f2d5c5a95867 for instance dee689b0-177a-4265-a296-c75cd57e74ba on user Apr 19 13:58:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-e74b66e0-8e5e-4293-b8f0-ae67b005519f req-67751d4e-36ba-4552-bd18-64cffe331d7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042085 Apr 19 13:58:41 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:42 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:42 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:42 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-190364120", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "networks": [{"uuid": "50d1390b-26bc-4e35-bf52-a3afc6e414f8"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:42 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] validate_networks() for [('50d1390b-26bc-4e35-bf52-a3afc6e414f8', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Getting quotas for project b882fb2e40e74c88a69342ca2385b28f. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Getting quotas for user ee0088ff4bd64218b490c3414afb1c76 and project b882fb2e40e74c88a69342ca2385b28f. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:58:43 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: 8744c453-cbe5-46cf-ae39-61dc93058d80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:58:43 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c0b11d4a-c7d1-4cb6-9efd-5135065b1034 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.487897 Apr 19 13:58:43 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 41/123] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 13:58:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 13:58:43 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-77679921-f894-44e2-a43c-0db4695283c4 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:43 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-77679921-f894-44e2-a43c-0db4695283c4 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: 8744c453-cbe5-46cf-ae39-61dc93058d80] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:43 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-77679921-f894-44e2-a43c-0db4695283c4 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0088ff4bd64218b490c3414afb1c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b882fb2e40e74c88a69342ca2385b28f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-77679921-f894-44e2-a43c-0db4695283c4 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80" status: 200 len: 1211 microversion: 2.1 time: 0.079506 Apr 19 13:58:43 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 43/124] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:58:43 2023] GET /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80 => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:58:45 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-a1119b5a-fc31-4954-8a2e-8c175e4a5142 req-40cb1e3b-86df-4be4-86e8-c98f0702c199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8744c453-cbe5-46cf-ae39-61dc93058d80", "tag": "435e84d7-a301-4ac0-b69e-ab3e083341d2"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-a1119b5a-fc31-4954-8a2e-8c175e4a5142 req-40cb1e3b-86df-4be4-86e8-c98f0702c199 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-a1119b5a-fc31-4954-8a2e-8c175e4a5142 req-40cb1e3b-86df-4be4-86e8-c98f0702c199 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:45 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-a1119b5a-fc31-4954-8a2e-8c175e4a5142 req-40cb1e3b-86df-4be4-86e8-c98f0702c199 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-a1119b5a-fc31-4954-8a2e-8c175e4a5142 req-40cb1e3b-86df-4be4-86e8-c98f0702c199 service nova] Creating event network-changed:435e84d7-a301-4ac0-b69e-ab3e083341d2 for instance 8744c453-cbe5-46cf-ae39-61dc93058d80 on user Apr 19 13:58:45 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-a1119b5a-fc31-4954-8a2e-8c175e4a5142 req-40cb1e3b-86df-4be4-86e8-c98f0702c199 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033458 Apr 19 13:58:45 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 41/125] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:47 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-d84a2af6-8de0-4267-bd74-7a205e294acb req-c5669d35-381c-49f8-9a21-08c6bbaabc68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8744c453-cbe5-46cf-ae39-61dc93058d80", "name": "network-vif-plugged", "status": "completed", "tag": "435e84d7-a301-4ac0-b69e-ab3e083341d2"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d84a2af6-8de0-4267-bd74-7a205e294acb req-c5669d35-381c-49f8-9a21-08c6bbaabc68 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d84a2af6-8de0-4267-bd74-7a205e294acb req-c5669d35-381c-49f8-9a21-08c6bbaabc68 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:47 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d84a2af6-8de0-4267-bd74-7a205e294acb req-c5669d35-381c-49f8-9a21-08c6bbaabc68 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:47 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-d84a2af6-8de0-4267-bd74-7a205e294acb req-c5669d35-381c-49f8-9a21-08c6bbaabc68 service nova] Creating event network-vif-plugged:435e84d7-a301-4ac0-b69e-ab3e083341d2 for instance 8744c453-cbe5-46cf-ae39-61dc93058d80 on user Apr 19 13:58:47 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-d84a2af6-8de0-4267-bd74-7a205e294acb req-c5669d35-381c-49f8-9a21-08c6bbaabc68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118977 Apr 19 13:58:47 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-348b60f9-8e68-4241-bf6d-2a0d33cd97da req-fdd51b40-68b0-40db-838e-53cb83262621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8744c453-cbe5-46cf-ae39-61dc93058d80", "name": "network-vif-plugged", "status": "completed", "tag": "435e84d7-a301-4ac0-b69e-ab3e083341d2"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-348b60f9-8e68-4241-bf6d-2a0d33cd97da req-fdd51b40-68b0-40db-838e-53cb83262621 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-348b60f9-8e68-4241-bf6d-2a0d33cd97da req-fdd51b40-68b0-40db-838e-53cb83262621 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-348b60f9-8e68-4241-bf6d-2a0d33cd97da req-fdd51b40-68b0-40db-838e-53cb83262621 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-348b60f9-8e68-4241-bf6d-2a0d33cd97da req-fdd51b40-68b0-40db-838e-53cb83262621 service nova] Creating event network-vif-plugged:435e84d7-a301-4ac0-b69e-ab3e083341d2 for instance 8744c453-cbe5-46cf-ae39-61dc93058d80 on user Apr 19 13:58:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-348b60f9-8e68-4241-bf6d-2a0d33cd97da req-fdd51b40-68b0-40db-838e-53cb83262621 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Apr 19 13:58:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 44/127] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:53 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b301f3f2-f6e4-4e7a-80ee-8b24bac06cb0 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:53 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-b301f3f2-f6e4-4e7a-80ee-8b24bac06cb0 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] [instance: 0b41bbd3-cf76-4be0-8d76-c22496a7fe23] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b301f3f2-f6e4-4e7a-80ee-8b24bac06cb0 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b301f3f2-f6e4-4e7a-80ee-8b24bac06cb0 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b301f3f2-f6e4-4e7a-80ee-8b24bac06cb0 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b301f3f2-f6e4-4e7a-80ee-8b24bac06cb0 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b301f3f2-f6e4-4e7a-80ee-8b24bac06cb0 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b301f3f2-f6e4-4e7a-80ee-8b24bac06cb0 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:53 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b301f3f2-f6e4-4e7a-80ee-8b24bac06cb0 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.159374 Apr 19 13:58:53 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 42/128] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 13:58:53 2023] GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23/os-interface => generated 282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:54 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:54 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-341eed75-c454-4b0f-9ac0-6a0d453af6da req-322259b8-86a0-4eb6-a247-4227bd7c97b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b41bbd3-cf76-4be0-8d76-c22496a7fe23", "tag": "68aa0fed-082c-48a5-905f-b1fe97b83dbb"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-341eed75-c454-4b0f-9ac0-6a0d453af6da req-322259b8-86a0-4eb6-a247-4227bd7c97b7 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-341eed75-c454-4b0f-9ac0-6a0d453af6da req-322259b8-86a0-4eb6-a247-4227bd7c97b7 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-341eed75-c454-4b0f-9ac0-6a0d453af6da req-322259b8-86a0-4eb6-a247-4227bd7c97b7 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-341eed75-c454-4b0f-9ac0-6a0d453af6da req-322259b8-86a0-4eb6-a247-4227bd7c97b7 service nova] Creating event network-changed:68aa0fed-082c-48a5-905f-b1fe97b83dbb for instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 on user Apr 19 13:58:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-341eed75-c454-4b0f-9ac0-6a0d453af6da req-322259b8-86a0-4eb6-a247-4227bd7c97b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062898 Apr 19 13:58:54 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:56 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:58:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cc3a04a2-f31d-4144-adc7-e4b38a7cea55 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:56 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-cc3a04a2-f31d-4144-adc7-e4b38a7cea55 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] [instance: 0b41bbd3-cf76-4be0-8d76-c22496a7fe23] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cc3a04a2-f31d-4144-adc7-e4b38a7cea55 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cc3a04a2-f31d-4144-adc7-e4b38a7cea55 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cc3a04a2-f31d-4144-adc7-e4b38a7cea55 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cc3a04a2-f31d-4144-adc7-e4b38a7cea55 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cc3a04a2-f31d-4144-adc7-e4b38a7cea55 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cc3a04a2-f31d-4144-adc7-e4b38a7cea55 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:56 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-cc3a04a2-f31d-4144-adc7-e4b38a7cea55 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] [instance: 0b41bbd3-cf76-4be0-8d76-c22496a7fe23] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 13:58:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cc3a04a2-f31d-4144-adc7-e4b38a7cea55 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23" status: 204 len: 0 microversion: 2.1 time: 0.139930 Apr 19 13:58:56 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 45/130] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 13:58:56 2023] DELETE /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 13:58:56 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ec1808ad-2fa0-4772-ac8f-e1150fbb6e35 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:58:56 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ec1808ad-2fa0-4772-ac8f-e1150fbb6e35 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] [instance: 0b41bbd3-cf76-4be0-8d76-c22496a7fe23] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:58:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec1808ad-2fa0-4772-ac8f-e1150fbb6e35 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec1808ad-2fa0-4772-ac8f-e1150fbb6e35 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec1808ad-2fa0-4772-ac8f-e1150fbb6e35 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec1808ad-2fa0-4772-ac8f-e1150fbb6e35 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec1808ad-2fa0-4772-ac8f-e1150fbb6e35 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:56 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec1808ad-2fa0-4772-ac8f-e1150fbb6e35 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:56 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-ec1808ad-2fa0-4772-ac8f-e1150fbb6e35 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd0c03d870041c58e7a857d65e066cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0dfe1cb247c4e68bd5dbbe1ccce3100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:58:56 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ec1808ad-2fa0-4772-ac8f-e1150fbb6e35 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23" status: 200 len: 1673 microversion: 2.1 time: 0.166402 Apr 19 13:58:56 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 43/131] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:58:56 2023] GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:58:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-ee4c670a-a577-4d6e-ad71-a4bd1f51d8b3 req-e9f26213-9eaa-41a1-8594-698ad1304054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b41bbd3-cf76-4be0-8d76-c22496a7fe23", "name": "network-vif-unplugged", "status": "completed", "tag": "68aa0fed-082c-48a5-905f-b1fe97b83dbb"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ee4c670a-a577-4d6e-ad71-a4bd1f51d8b3 req-e9f26213-9eaa-41a1-8594-698ad1304054 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ee4c670a-a577-4d6e-ad71-a4bd1f51d8b3 req-e9f26213-9eaa-41a1-8594-698ad1304054 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ee4c670a-a577-4d6e-ad71-a4bd1f51d8b3 req-e9f26213-9eaa-41a1-8594-698ad1304054 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-ee4c670a-a577-4d6e-ad71-a4bd1f51d8b3 req-e9f26213-9eaa-41a1-8594-698ad1304054 service nova] Creating event network-vif-unplugged:68aa0fed-082c-48a5-905f-b1fe97b83dbb for instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 on user Apr 19 13:58:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-ee4c670a-a577-4d6e-ad71-a4bd1f51d8b3 req-e9f26213-9eaa-41a1-8594-698ad1304054 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034089 Apr 19 13:58:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 44/132] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-d55f0a0a-388a-4709-aa8a-3c0b0b6560fd req-11e6e44d-1156-4450-b90d-870401a3b63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b41bbd3-cf76-4be0-8d76-c22496a7fe23", "name": "network-vif-deleted", "tag": "68aa0fed-082c-48a5-905f-b1fe97b83dbb"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d55f0a0a-388a-4709-aa8a-3c0b0b6560fd req-11e6e44d-1156-4450-b90d-870401a3b63e service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d55f0a0a-388a-4709-aa8a-3c0b0b6560fd req-11e6e44d-1156-4450-b90d-870401a3b63e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:58 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d55f0a0a-388a-4709-aa8a-3c0b0b6560fd req-11e6e44d-1156-4450-b90d-870401a3b63e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-d55f0a0a-388a-4709-aa8a-3c0b0b6560fd req-11e6e44d-1156-4450-b90d-870401a3b63e service nova] Creating event network-vif-deleted:68aa0fed-082c-48a5-905f-b1fe97b83dbb for instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 on user Apr 19 13:58:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-d55f0a0a-388a-4709-aa8a-3c0b0b6560fd req-11e6e44d-1156-4450-b90d-870401a3b63e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041358 Apr 19 13:58:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 46/133] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:58:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-0ffa53cc-895b-4eb8-a2b0-beed37ec1ed3 req-47dcdb8f-1d3d-4dcd-9a3a-c14dbb375207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b41bbd3-cf76-4be0-8d76-c22496a7fe23", "name": "network-vif-plugged", "status": "completed", "tag": "68aa0fed-082c-48a5-905f-b1fe97b83dbb"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:58:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0ffa53cc-895b-4eb8-a2b0-beed37ec1ed3 req-47dcdb8f-1d3d-4dcd-9a3a-c14dbb375207 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:58:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0ffa53cc-895b-4eb8-a2b0-beed37ec1ed3 req-47dcdb8f-1d3d-4dcd-9a3a-c14dbb375207 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:58:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0ffa53cc-895b-4eb8-a2b0-beed37ec1ed3 req-47dcdb8f-1d3d-4dcd-9a3a-c14dbb375207 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:58:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-0ffa53cc-895b-4eb8-a2b0-beed37ec1ed3 req-47dcdb8f-1d3d-4dcd-9a3a-c14dbb375207 service nova] Creating event network-vif-plugged:68aa0fed-082c-48a5-905f-b1fe97b83dbb for instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 on user Apr 19 13:58:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-0ffa53cc-895b-4eb8-a2b0-beed37ec1ed3 req-47dcdb8f-1d3d-4dcd-9a3a-c14dbb375207 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027803 Apr 19 13:58:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 44/134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:58:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a3504114-33f8-4b33-9ad4-8761a5673f4d tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:02 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-a3504114-33f8-4b33-9ad4-8761a5673f4d tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 33751f45-cd9e-4b2c-ad4d-1049db7ef555] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3504114-33f8-4b33-9ad4-8761a5673f4d tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3504114-33f8-4b33-9ad4-8761a5673f4d tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3504114-33f8-4b33-9ad4-8761a5673f4d tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3504114-33f8-4b33-9ad4-8761a5673f4d tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3504114-33f8-4b33-9ad4-8761a5673f4d tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3504114-33f8-4b33-9ad4-8761a5673f4d tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:02 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-a3504114-33f8-4b33-9ad4-8761a5673f4d tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-a3504114-33f8-4b33-9ad4-8761a5673f4d tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555" status: 200 len: 1538 microversion: 2.1 time: 0.253219 Apr 19 13:59:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 45/135] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:02 2023] GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555 => generated 1538 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:59:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:02 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:02 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Searching by: {'deleted': False, 'project_id': '833c753ebd4a43f3a70e30069a91f159'} {{(pid=61612) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 19 13:59:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:03 user devstack@n-api.service[61612]: DEBUG nova.compute.multi_cell_list [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 19 13:59:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-fad6cd1d-aa38-471d-afd4-8cba8b7b5614 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.549857 Apr 19 13:59:03 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 47/136] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 19 13:59:02 2023] GET /compute/v2.1/servers => generated 341 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-6520f026-dacb-4603-8b61-6800a6c8e979 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:03 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-6520f026-dacb-4603-8b61-6800a6c8e979 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 33751f45-cd9e-4b2c-ad4d-1049db7ef555] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6520f026-dacb-4603-8b61-6800a6c8e979 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6520f026-dacb-4603-8b61-6800a6c8e979 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6520f026-dacb-4603-8b61-6800a6c8e979 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6520f026-dacb-4603-8b61-6800a6c8e979 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6520f026-dacb-4603-8b61-6800a6c8e979 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6520f026-dacb-4603-8b61-6800a6c8e979 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:03 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-6520f026-dacb-4603-8b61-6800a6c8e979 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-6520f026-dacb-4603-8b61-6800a6c8e979 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555" status: 200 len: 1538 microversion: 2.1 time: 0.311909 Apr 19 13:59:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 45/137] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:03 2023] GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555 => generated 1538 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:59:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f540e79a-4c0a-4df7-aa41-0b0c20105f73 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:05 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f540e79a-4c0a-4df7-aa41-0b0c20105f73 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 33751f45-cd9e-4b2c-ad4d-1049db7ef555] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f540e79a-4c0a-4df7-aa41-0b0c20105f73 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f540e79a-4c0a-4df7-aa41-0b0c20105f73 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f540e79a-4c0a-4df7-aa41-0b0c20105f73 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f540e79a-4c0a-4df7-aa41-0b0c20105f73 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f540e79a-4c0a-4df7-aa41-0b0c20105f73 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f540e79a-4c0a-4df7-aa41-0b0c20105f73 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:05 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f540e79a-4c0a-4df7-aa41-0b0c20105f73 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 33751f45-cd9e-4b2c-ad4d-1049db7ef555] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 13:59:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-f540e79a-4c0a-4df7-aa41-0b0c20105f73 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555" status: 204 len: 0 microversion: 2.1 time: 0.121418 Apr 19 13:59:05 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 46/138] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 13:59:05 2023] DELETE /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 13:59:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4dabed18-b6d6-4853-be65-8cb98cd175c6 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:05 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-4dabed18-b6d6-4853-be65-8cb98cd175c6 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 33751f45-cd9e-4b2c-ad4d-1049db7ef555] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dabed18-b6d6-4853-be65-8cb98cd175c6 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dabed18-b6d6-4853-be65-8cb98cd175c6 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dabed18-b6d6-4853-be65-8cb98cd175c6 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dabed18-b6d6-4853-be65-8cb98cd175c6 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dabed18-b6d6-4853-be65-8cb98cd175c6 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-4dabed18-b6d6-4853-be65-8cb98cd175c6 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:05 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-4dabed18-b6d6-4853-be65-8cb98cd175c6 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:05 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4dabed18-b6d6-4853-be65-8cb98cd175c6 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555" status: 200 len: 1544 microversion: 2.1 time: 0.230774 Apr 19 13:59:05 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 48/139] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:05 2023] GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555 => generated 1544 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:59:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-f26cb15d-68a2-458b-a320-6d17b5ea034e req-f07ab3cf-4790-4069-9172-9022b65c0ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33751f45-cd9e-4b2c-ad4d-1049db7ef555", "name": "network-vif-unplugged", "status": "completed", "tag": "02e84e5e-7d3e-4135-93fb-49791bf9f3f1"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f26cb15d-68a2-458b-a320-6d17b5ea034e req-f07ab3cf-4790-4069-9172-9022b65c0ede service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f26cb15d-68a2-458b-a320-6d17b5ea034e req-f07ab3cf-4790-4069-9172-9022b65c0ede service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f26cb15d-68a2-458b-a320-6d17b5ea034e req-f07ab3cf-4790-4069-9172-9022b65c0ede service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f26cb15d-68a2-458b-a320-6d17b5ea034e req-f07ab3cf-4790-4069-9172-9022b65c0ede service nova] Creating event network-vif-unplugged:02e84e5e-7d3e-4135-93fb-49791bf9f3f1 for instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 on user Apr 19 13:59:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-f26cb15d-68a2-458b-a320-6d17b5ea034e req-f07ab3cf-4790-4069-9172-9022b65c0ede service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032170 Apr 19 13:59:05 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 46/140] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 13:59:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-0b992464-f4b2-4b97-93f5-6cb375457b11 req-7f1ac286-e107-4e45-859a-83baefd87334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33751f45-cd9e-4b2c-ad4d-1049db7ef555", "name": "network-vif-deleted", "tag": "02e84e5e-7d3e-4135-93fb-49791bf9f3f1"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0b992464-f4b2-4b97-93f5-6cb375457b11 req-7f1ac286-e107-4e45-859a-83baefd87334 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0b992464-f4b2-4b97-93f5-6cb375457b11 req-7f1ac286-e107-4e45-859a-83baefd87334 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0b992464-f4b2-4b97-93f5-6cb375457b11 req-7f1ac286-e107-4e45-859a-83baefd87334 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-0b992464-f4b2-4b97-93f5-6cb375457b11 req-7f1ac286-e107-4e45-859a-83baefd87334 service nova] Creating event network-vif-deleted:02e84e5e-7d3e-4135-93fb-49791bf9f3f1 for instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 on user Apr 19 13:59:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-0b992464-f4b2-4b97-93f5-6cb375457b11 req-7f1ac286-e107-4e45-859a-83baefd87334 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029197 Apr 19 13:59:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 47/141] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-c9e77043-0127-4fdc-94a8-c348c44f9f96 req-d5340dee-29f8-45cb-a2b9-e8b839f7194e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33751f45-cd9e-4b2c-ad4d-1049db7ef555", "name": "network-vif-plugged", "status": "completed", "tag": "02e84e5e-7d3e-4135-93fb-49791bf9f3f1"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c9e77043-0127-4fdc-94a8-c348c44f9f96 req-d5340dee-29f8-45cb-a2b9-e8b839f7194e service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c9e77043-0127-4fdc-94a8-c348c44f9f96 req-d5340dee-29f8-45cb-a2b9-e8b839f7194e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c9e77043-0127-4fdc-94a8-c348c44f9f96 req-d5340dee-29f8-45cb-a2b9-e8b839f7194e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-c9e77043-0127-4fdc-94a8-c348c44f9f96 req-d5340dee-29f8-45cb-a2b9-e8b839f7194e service nova] Creating event network-vif-plugged:02e84e5e-7d3e-4135-93fb-49791bf9f3f1 for instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 on user Apr 19 13:59:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-c9e77043-0127-4fdc-94a8-c348c44f9f96 req-d5340dee-29f8-45cb-a2b9-e8b839f7194e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029543 Apr 19 13:59:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 49/142] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1567148178", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "networks": [{"uuid": "6b06bfe4-942c-453a-af17-cdacc4c2e704"}]}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:10 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] validate_networks() for [('6b06bfe4-942c-453a-af17-cdacc4c2e704', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=17 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=25 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Getting quotas for project 806255a694c7446893131ff6de13c42d. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Getting quotas for user 9bb00927681348c08cabf5cea1edaac2 and project 806255a694c7446893131ff6de13c42d. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:59:11 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: 478b7934-6a66-4630-b756-521846ab8230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:59:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-6e7d6d40-bb8e-49fd-9be3-e30d9e1729ad tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.577383 Apr 19 13:59:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 47/143] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 13:59:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 13:59:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-4368afb4-0e4a-4f9d-8670-1c07c4d5942f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-4368afb4-0e4a-4f9d-8670-1c07c4d5942f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: 478b7934-6a66-4630-b756-521846ab8230] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:11 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-4368afb4-0e4a-4f9d-8670-1c07c4d5942f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb00927681348c08cabf5cea1edaac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806255a694c7446893131ff6de13c42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-4368afb4-0e4a-4f9d-8670-1c07c4d5942f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230" status: 200 len: 1211 microversion: 2.1 time: 0.062689 Apr 19 13:59:11 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:11 2023] GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230 => generated 1211 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] [instance: df6a7f5d-e8d6-4a01-90e4-6869692de6b7] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] HTTP exception thrown: Instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 could not be found. Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Request method failure captured: Apr 19 13:59:13 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7 HTTP/1.1 Apr 19 13:59:13 user devstack@n-api.service[61612]: Accept: application/json Apr 19 13:59:13 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 13:59:13 user devstack@n-api.service[61612]: Connection: close Apr 19 13:59:13 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 13:59:13 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 13:59:13 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 13:59:13 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 13:59:13 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_MMGP40TcjMDAX-PU7kiZ-NqUkvc_0MbBmuu1biPR4g8aKdw8HuNvOLqQfThn9m84atLNvjyP9Hs_WSHoz1LAtEpgEOujdFCpKrjwUvDF3nAx_XMqUS-xq8R2KHJOqoUkoSSq3XSqajmTphbXhaQnhG52HqqEnRYmA-gyJM8gMZoXo Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Project-Id: 1c9b8f883c474db9a4e766b9262f4217 Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Project-Name: tempest-DeleteServersTestJSON-165444164 Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c9b8f883c474db9a4e766b9262f4217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c9b8f883c474db9a4e766b9262f4217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1c9b8f883c474db9a4e766b9262f4217"}]}] Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Tenant: tempest-DeleteServersTestJSON-165444164 Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Tenant-Id: 1c9b8f883c474db9a4e766b9262f4217 Apr 19 13:59:13 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-DeleteServersTestJSON-165444164 Apr 19 13:59:13 user devstack@n-api.service[61612]: X-User: tempest-DeleteServersTestJSON-165444164-project-member Apr 19 13:59:13 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 13:59:13 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 13:59:13 user devstack@n-api.service[61612]: X-User-Id: 6005f003a23749bd9b9b00c87dec971c Apr 19 13:59:13 user devstack@n-api.service[61612]: X-User-Name: tempest-DeleteServersTestJSON-165444164-project-member Apr 19 13:59:13 user devstack@n-api.service[61612]: method: > Apr 19 13:59:13 user devstack@n-api.service[61612]: exception: Instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 could not be found. Apr 19 13:59:13 user devstack@n-api.service[61612]: action_args: {'id': 'df6a7f5d-e8d6-4a01-90e4-6869692de6b7'} Apr 19 13:59:13 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 could not be found. Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 could not be found. Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 could not be found. Apr 19 13:59:13 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 13:59:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] Returning 404 to user: Instance df6a7f5d-e8d6-4a01-90e4-6869692de6b7 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-8885acb8-7c18-4d36-9449-20e70a533486 tempest-DeleteServersTestJSON-165444164 tempest-DeleteServersTestJSON-165444164-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7" status: 404 len: 111 microversion: 2.1 time: 0.046055 Apr 19 13:59:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 50/145] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:13 2023] GET /compute/v2.1/servers/df6a7f5d-e8d6-4a01-90e4-6869692de6b7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 13:59:14 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-b0d11bdf-e70b-43fb-baec-14bc94af2383 req-437792f7-faa6-4f89-88de-09ac871b7373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478b7934-6a66-4630-b756-521846ab8230", "tag": "8858b70a-e3d6-4655-96a0-864080bd96a9"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b0d11bdf-e70b-43fb-baec-14bc94af2383 req-437792f7-faa6-4f89-88de-09ac871b7373 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b0d11bdf-e70b-43fb-baec-14bc94af2383 req-437792f7-faa6-4f89-88de-09ac871b7373 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:14 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b0d11bdf-e70b-43fb-baec-14bc94af2383 req-437792f7-faa6-4f89-88de-09ac871b7373 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-b0d11bdf-e70b-43fb-baec-14bc94af2383 req-437792f7-faa6-4f89-88de-09ac871b7373 service nova] Creating event network-changed:8858b70a-e3d6-4655-96a0-864080bd96a9 for instance 478b7934-6a66-4630-b756-521846ab8230 on user Apr 19 13:59:14 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-b0d11bdf-e70b-43fb-baec-14bc94af2383 req-437792f7-faa6-4f89-88de-09ac871b7373 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030288 Apr 19 13:59:14 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 48/146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a0d5a749-4f2f-453f-b671-178ef2293034 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-a0d5a749-4f2f-453f-b671-178ef2293034 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a0d5a749-4f2f-453f-b671-178ef2293034 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a0d5a749-4f2f-453f-b671-178ef2293034 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a0d5a749-4f2f-453f-b671-178ef2293034 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a0d5a749-4f2f-453f-b671-178ef2293034 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a0d5a749-4f2f-453f-b671-178ef2293034 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a0d5a749-4f2f-453f-b671-178ef2293034 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-a0d5a749-4f2f-453f-b671-178ef2293034 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.243451 Apr 19 13:59:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 13:59:16 2023] GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759/os-interface => generated 282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-4f5222cf-37e2-4e65-a06d-c09ea16098b0 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '.version_select at 0x7f60de4d93f0>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-4f5222cf-37e2-4e65-a06d-c09ea16098b0 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "GET /compute/v2.1/images/b1a1059c-a29c-435a-aaff-8993a28bfc9d" status: 200 len: 1723 microversion: 2.1 time: 0.051134 Apr 19 13:59:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 51/148] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 13:59:16 2023] GET /compute/v2.1/images/b1a1059c-a29c-435a-aaff-8993a28bfc9d => generated 1723 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:59:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-dd966c1f-c841-41bc-a703-9edfee186a3d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '.version_select at 0x7f60de70dc60>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-dd966c1f-c841-41bc-a703-9edfee186a3d tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "GET /compute/v2.1/images/b1a1059c-a29c-435a-aaff-8993a28bfc9d" status: 200 len: 1723 microversion: 2.1 time: 0.064962 Apr 19 13:59:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 49/149] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 13:59:16 2023] GET /compute/v2.1/images/b1a1059c-a29c-435a-aaff-8993a28bfc9d => generated 1723 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d1261805-093f-4be7-bdf5-b930eb92e8cd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d1261805-093f-4be7-bdf5-b930eb92e8cd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d1261805-093f-4be7-bdf5-b930eb92e8cd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d1261805-093f-4be7-bdf5-b930eb92e8cd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d1261805-093f-4be7-bdf5-b930eb92e8cd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d1261805-093f-4be7-bdf5-b930eb92e8cd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d1261805-093f-4be7-bdf5-b930eb92e8cd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d1261805-093f-4be7-bdf5-b930eb92e8cd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:16 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d1261805-093f-4be7-bdf5-b930eb92e8cd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3a097ff4d04a0287c417b23d3b00e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f754b42ccea544d4a34e986a6119db51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d1261805-093f-4be7-bdf5-b930eb92e8cd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f" status: 200 len: 1670 microversion: 2.1 time: 0.231647 Apr 19 13:59:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 50/150] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:16 2023] GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f => generated 1670 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:59:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-80b406c8-9867-46b0-9e79-2def9345bc53 req-8f418370-82b6-4fdd-8c6d-c4dd40db6ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478b7934-6a66-4630-b756-521846ab8230", "name": "network-vif-plugged", "status": "completed", "tag": "8858b70a-e3d6-4655-96a0-864080bd96a9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-80b406c8-9867-46b0-9e79-2def9345bc53 req-8f418370-82b6-4fdd-8c6d-c4dd40db6ae5 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-80b406c8-9867-46b0-9e79-2def9345bc53 req-8f418370-82b6-4fdd-8c6d-c4dd40db6ae5 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-80b406c8-9867-46b0-9e79-2def9345bc53 req-8f418370-82b6-4fdd-8c6d-c4dd40db6ae5 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-80b406c8-9867-46b0-9e79-2def9345bc53 req-8f418370-82b6-4fdd-8c6d-c4dd40db6ae5 service nova] Creating event network-vif-plugged:8858b70a-e3d6-4655-96a0-864080bd96a9 for instance 478b7934-6a66-4630-b756-521846ab8230 on user Apr 19 13:59:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-80b406c8-9867-46b0-9e79-2def9345bc53 req-8f418370-82b6-4fdd-8c6d-c4dd40db6ae5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037171 Apr 19 13:59:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 52/151] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:17 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d5a5a7ac-3110-4509-9843-c2fef9f51480 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:17 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d5a5a7ac-3110-4509-9843-c2fef9f51480 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d5a5a7ac-3110-4509-9843-c2fef9f51480 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d5a5a7ac-3110-4509-9843-c2fef9f51480 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d5a5a7ac-3110-4509-9843-c2fef9f51480 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d5a5a7ac-3110-4509-9843-c2fef9f51480 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d5a5a7ac-3110-4509-9843-c2fef9f51480 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d5a5a7ac-3110-4509-9843-c2fef9f51480 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] HTTP exception thrown: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 13:59:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Request method failure captured: Apr 19 13:59:17 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b HTTP/1.1 Apr 19 13:59:17 user devstack@n-api.service[61611]: Accept: application/json Apr 19 13:59:17 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 13:59:17 user devstack@n-api.service[61611]: Connection: close Apr 19 13:59:17 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 13:59:17 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 13:59:17 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 13:59:17 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 13:59:17 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_MDiDeU3z5Oj0o7maoG-JahmsnDswZzSHArZroi7Im2Zlvgb-UjHSDNsJ4POX2kmEUEQupTojjrXkZn7svHgef6jH6zEGBlp7kEtcgg4ZDLJ353e-PJu3xQ6T3z4NgEqzmTFW779KaZCoAeFrPGIPz1pP69Acr761N7F3Z3fqAkdsQ Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Project-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d2b244a7fcf46baab5d636ba6e58fb7"}]}] Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Tenant-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 13:59:17 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 13:59:17 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 13:59:17 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 13:59:17 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 13:59:17 user devstack@n-api.service[61611]: X-User-Id: 825cd7cdbfad406197e3230a687dcfcc Apr 19 13:59:17 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 13:59:17 user devstack@n-api.service[61611]: method: > Apr 19 13:59:17 user devstack@n-api.service[61611]: exception: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 13:59:17 user devstack@n-api.service[61611]: action_args: {'id': '20c95eb6-9d18-41fa-b334-0c423a01241b'} Apr 19 13:59:17 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 13:59:17 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Returning 404 to user: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8743c187-0299-4875-ae5a-7de5672493b9 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b" status: 404 len: 111 microversion: 2.20 time: 0.032556 Apr 19 13:59:17 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 50/152] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 13:59:17 2023] GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 13:59:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d5a5a7ac-3110-4509-9843-c2fef9f51480 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759/ips" status: 200 len: 107 microversion: 2.1 time: 0.036599 Apr 19 13:59:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 51/153] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 13:59:17 2023] GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759/ips => generated 107 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-7ac138cb-0822-40b6-961f-80f5488177ef tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '.version_select at 0x7f60de4d9990>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-7ac138cb-0822-40b6-961f-80f5488177ef tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442750450" status: 204 len: 0 microversion: 2.20 time: 0.027664 Apr 19 13:59:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 53/154] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 19 13:59:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442750450 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 13:59:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c96b3f03-43a9-4316-bb24-636390cf88d3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Action: 'create', calling method: .version_select at 0x7f60de5e2200>, body: {"keypair": {"name": "tempest-keypair-824893131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaypXa1N3dushLmF0anTxsHXhJW5mb1XtuBL/cClN1q5jd7K3MhpXEA+bmbDbzW6OS5PnA/QU5VwPwjgvMnrpiqikVJ9Svt6FKtMglxhahxn4cN+p4HdnEBya1pnvWLA=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:18 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-c96b3f03-43a9-4316-bb24-636390cf88d3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Getting quotas for project 8d2b244a7fcf46baab5d636ba6e58fb7. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:59:18 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-c96b3f03-43a9-4316-bb24-636390cf88d3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Getting quotas for user 825cd7cdbfad406197e3230a687dcfcc and project 8d2b244a7fcf46baab5d636ba6e58fb7. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:59:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c96b3f03-43a9-4316-bb24-636390cf88d3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.055691 Apr 19 13:59:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 51/155] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 19 13:59:18 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 19 13:59:18 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d6edace9-7516-4b80-ae74-4e99e4581be3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-2120400162"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:18 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d6edace9-7516-4b80-ae74-4e99e4581be3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 7dd44282-31f1-44b8-a8a4-9c7556736201] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ace7588f-1001-4cae-81ad-48240113df9a tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Action: 'create', calling method: .version_select at 0x7f60de694040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-499927443", "metadata": {"Type": "work"}}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d6edace9-7516-4b80-ae74-4e99e4581be3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d6edace9-7516-4b80-ae74-4e99e4581be3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d6edace9-7516-4b80-ae74-4e99e4581be3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ace7588f-1001-4cae-81ad-48240113df9a tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Request method failure captured: Apr 19 13:59:18 user devstack@n-api.service[61613]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 13:59:18 user devstack@n-api.service[61613]: Accept: application/json Apr 19 13:59:18 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 13:59:18 user devstack@n-api.service[61613]: Connection: close Apr 19 13:59:18 user devstack@n-api.service[61613]: Content-Length: 121 Apr 19 13:59:18 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 13:59:18 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 13:59:18 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 13:59:18 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_O23Q9qPvkNzf28woLtxjk40eWvb_yB7Niym-I-ALS24HL07B_DKUqDkynplpmzrNvrYUR1O-UzZOecV-kix964_0UFAzGZLbtvWVOUH2AQexyX7xnGee5-Wzo04HEbleqpOJ39PHWA_hlAKo9qL8s4omW46Z1OUjhG4tRPZa3HEHw Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Project-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a3edb3387c44ef099d0a5f350f4f20e"}]}] Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Tenant-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:18 user devstack@n-api.service[61613]: X-User: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:18 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 13:59:18 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 13:59:18 user devstack@n-api.service[61613]: X-User-Id: 3667dabf836c411ab7dffd636ab224c3 Apr 19 13:59:18 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:18 user devstack@n-api.service[61613]: Apr 19 13:59:18 user devstack@n-api.service[61613]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-499927443", "metadata": {"Type": "work"}}} Apr 19 13:59:18 user devstack@n-api.service[61613]: method: Apr 19 13:59:18 user devstack@n-api.service[61613]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 13:59:18 user devstack@n-api.service[61613]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-499927443', 'metadata': {'Type': 'work'}}}} Apr 19 13:59:18 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise error Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi '#$%' Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ace7588f-1001-4cae-81ad-48240113df9a tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-ace7588f-1001-4cae-81ad-48240113df9a tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.184623 Apr 19 13:59:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 52/156] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 13:59:18 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 13:59:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d6edace9-7516-4b80-ae74-4e99e4581be3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d6edace9-7516-4b80-ae74-4e99e4581be3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d6edace9-7516-4b80-ae74-4e99e4581be3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5a5096e7-753e-4987-8a27-69b93093a285 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Action: 'create', calling method: .version_select at 0x7f60de5e1ea0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1866452199", "metadata": {"Type": "work"}}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5a5096e7-753e-4987-8a27-69b93093a285 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Request method failure captured: Apr 19 13:59:18 user devstack@n-api.service[61611]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 13:59:18 user devstack@n-api.service[61611]: Accept: application/json Apr 19 13:59:18 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 13:59:18 user devstack@n-api.service[61611]: Connection: close Apr 19 13:59:18 user devstack@n-api.service[61611]: Content-Length: 120 Apr 19 13:59:18 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 13:59:18 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 13:59:18 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 13:59:18 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_O23Q9qPvkNzf28woLtxjk40eWvb_yB7Niym-I-ALS24HL07B_DKUqDkynplpmzrNvrYUR1O-UzZOecV-kix964_0UFAzGZLbtvWVOUH2AQexyX7xnGee5-Wzo04HEbleqpOJ39PHWA_hlAKo9qL8s4omW46Z1OUjhG4tRPZa3HEHw Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Project-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Project-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a3edb3387c44ef099d0a5f350f4f20e"}]}] Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Tenant: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Tenant-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:18 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:18 user devstack@n-api.service[61611]: X-User: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:18 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 13:59:18 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 13:59:18 user devstack@n-api.service[61611]: X-User-Id: 3667dabf836c411ab7dffd636ab224c3 Apr 19 13:59:18 user devstack@n-api.service[61611]: X-User-Name: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:18 user devstack@n-api.service[61611]: Apr 19 13:59:18 user devstack@n-api.service[61611]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1866452199", "metadata": {"Type": "work"}}} Apr 19 13:59:18 user devstack@n-api.service[61611]: method: Apr 19 13:59:18 user devstack@n-api.service[61611]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 13:59:18 user devstack@n-api.service[61611]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1866452199', 'metadata': {'Type': 'work'}}}} Apr 19 13:59:18 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise error Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi '0' Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 13:59:18 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-5a5096e7-753e-4987-8a27-69b93093a285 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-5a5096e7-753e-4987-8a27-69b93093a285 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015615 Apr 19 13:59:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 52/157] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 13:59:18 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 19 13:59:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-92773730-a8af-4f2a-8e1f-1aabf6283805 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Action: 'create', calling method: .version_select at 0x7f60df0eeb00>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1734142725", "metadata": {"Type": "work"}}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-92773730-a8af-4f2a-8e1f-1aabf6283805 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Request method failure captured: Apr 19 13:59:18 user devstack@n-api.service[61613]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 13:59:18 user devstack@n-api.service[61613]: Accept: application/json Apr 19 13:59:18 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 13:59:18 user devstack@n-api.service[61613]: Connection: close Apr 19 13:59:18 user devstack@n-api.service[61613]: Content-Length: 119 Apr 19 13:59:18 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 13:59:18 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 13:59:18 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 13:59:18 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_O23Q9qPvkNzf28woLtxjk40eWvb_yB7Niym-I-ALS24HL07B_DKUqDkynplpmzrNvrYUR1O-UzZOecV-kix964_0UFAzGZLbtvWVOUH2AQexyX7xnGee5-Wzo04HEbleqpOJ39PHWA_hlAKo9qL8s4omW46Z1OUjhG4tRPZa3HEHw Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Project-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a3edb3387c44ef099d0a5f350f4f20e"}]}] Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Tenant-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:18 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:18 user devstack@n-api.service[61613]: X-User: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:18 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 13:59:18 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 13:59:18 user devstack@n-api.service[61613]: X-User-Id: 3667dabf836c411ab7dffd636ab224c3 Apr 19 13:59:18 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:18 user devstack@n-api.service[61613]: Apr 19 13:59:18 user devstack@n-api.service[61613]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1734142725", "metadata": {"Type": "work"}}} Apr 19 13:59:18 user devstack@n-api.service[61613]: method: Apr 19 13:59:18 user devstack@n-api.service[61613]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 13:59:18 user devstack@n-api.service[61613]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1734142725', 'metadata': {'Type': 'work'}}}} Apr 19 13:59:18 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise error Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi '' Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 13:59:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-92773730-a8af-4f2a-8e1f-1aabf6283805 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-92773730-a8af-4f2a-8e1f-1aabf6283805 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011682 Apr 19 13:59:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 53/158] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 13:59:18 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 13:59:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7bfa0102-0cb1-4d23-bcc1-9c84c655db0c tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Calling method '.version_select at 0x7f60de5e39a0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2e55d244-7d76-4060-90fe-f853fe449761 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2e55d244-7d76-4060-90fe-f853fe449761 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-7bfa0102-0cb1-4d23-bcc1-9c84c655db0c tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] HTTP exception thrown: Volume tempest-invalid-871091199 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7bfa0102-0cb1-4d23-bcc1-9c84c655db0c tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Request method failure captured: Apr 19 13:59:19 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-871091199 HTTP/1.1 Apr 19 13:59:19 user devstack@n-api.service[61611]: Accept: application/json Apr 19 13:59:19 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 13:59:19 user devstack@n-api.service[61611]: Connection: close Apr 19 13:59:19 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 13:59:19 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 13:59:19 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 13:59:19 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 13:59:19 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_O23Q9qPvkNzf28woLtxjk40eWvb_yB7Niym-I-ALS24HL07B_DKUqDkynplpmzrNvrYUR1O-UzZOecV-kix964_0UFAzGZLbtvWVOUH2AQexyX7xnGee5-Wzo04HEbleqpOJ39PHWA_hlAKo9qL8s4omW46Z1OUjhG4tRPZa3HEHw Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a3edb3387c44ef099d0a5f350f4f20e"}]}] Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Tenant: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Tenant-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Id: 3667dabf836c411ab7dffd636ab224c3 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Name: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:19 user devstack@n-api.service[61611]: method: Apr 19 13:59:19 user devstack@n-api.service[61611]: exception: Volume tempest-invalid-871091199 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: action_args: {'id': 'tempest-invalid-871091199'} Apr 19 13:59:19 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-871091199 could not be found. (HTTP 404) (Request-ID: req-aa1d8bdb-4479-4b14-9436-b2f31c3af468) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-871091199 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-871091199 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-871091199 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2e55d244-7d76-4060-90fe-f853fe449761 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7bfa0102-0cb1-4d23-bcc1-9c84c655db0c tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Returning 404 to user: Volume tempest-invalid-871091199 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2e55d244-7d76-4060-90fe-f853fe449761 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7bfa0102-0cb1-4d23-bcc1-9c84c655db0c tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-871091199" status: 404 len: 98 microversion: 2.1 time: 0.075618 Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2e55d244-7d76-4060-90fe-f853fe449761 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 53/159] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 19 13:59:18 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-871091199 => generated 98 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2e55d244-7d76-4060-90fe-f853fe449761 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2e55d244-7d76-4060-90fe-f853fe449761 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2e55d244-7d76-4060-90fe-f853fe449761 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-fef5c546-7ab2-409b-90cf-96446b2e5aa5 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005394 Apr 19 13:59:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 54/160] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 19 13:59:19 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-dc3bea52-7d42-435b-941f-9b26d768b899 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004402 Apr 19 13:59:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 55/161] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 19 13:59:19 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4775a06d-fcfc-4f69-a4dd-a1548b7d6064 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Calling method '.version_select at 0x7f60de4b4ca0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2e55d244-7d76-4060-90fe-f853fe449761 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-4775a06d-fcfc-4f69-a4dd-a1548b7d6064 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] HTTP exception thrown: Volume 9cef876e-9305-4cd9-956d-a3aa34dfe5c1 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4775a06d-fcfc-4f69-a4dd-a1548b7d6064 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Request method failure captured: Apr 19 13:59:19 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/os-volumes/9cef876e-9305-4cd9-956d-a3aa34dfe5c1 HTTP/1.1 Apr 19 13:59:19 user devstack@n-api.service[61611]: Accept: application/json Apr 19 13:59:19 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 13:59:19 user devstack@n-api.service[61611]: Connection: close Apr 19 13:59:19 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 13:59:19 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 13:59:19 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 13:59:19 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 13:59:19 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_O23Q9qPvkNzf28woLtxjk40eWvb_yB7Niym-I-ALS24HL07B_DKUqDkynplpmzrNvrYUR1O-UzZOecV-kix964_0UFAzGZLbtvWVOUH2AQexyX7xnGee5-Wzo04HEbleqpOJ39PHWA_hlAKo9qL8s4omW46Z1OUjhG4tRPZa3HEHw Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a3edb3387c44ef099d0a5f350f4f20e"}]}] Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Tenant: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Tenant-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Id: 3667dabf836c411ab7dffd636ab224c3 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Name: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:19 user devstack@n-api.service[61611]: method: Apr 19 13:59:19 user devstack@n-api.service[61611]: exception: Volume 9cef876e-9305-4cd9-956d-a3aa34dfe5c1 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: action_args: {'id': '9cef876e-9305-4cd9-956d-a3aa34dfe5c1'} Apr 19 13:59:19 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9cef876e-9305-4cd9-956d-a3aa34dfe5c1 could not be found. (HTTP 404) (Request-ID: req-b3775e5d-fe44-462f-81e4-90dfe21e8af9) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9cef876e-9305-4cd9-956d-a3aa34dfe5c1 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9cef876e-9305-4cd9-956d-a3aa34dfe5c1 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9cef876e-9305-4cd9-956d-a3aa34dfe5c1 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4775a06d-fcfc-4f69-a4dd-a1548b7d6064 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Returning 404 to user: Volume 9cef876e-9305-4cd9-956d-a3aa34dfe5c1 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4775a06d-fcfc-4f69-a4dd-a1548b7d6064 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9cef876e-9305-4cd9-956d-a3aa34dfe5c1" status: 404 len: 109 microversion: 2.1 time: 0.047907 Apr 19 13:59:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 56/162] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 13:59:19 2023] DELETE /compute/v2.1/os-volumes/9cef876e-9305-4cd9-956d-a3aa34dfe5c1 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-363edaeb-34bf-41c2-8e3e-54de129d5372 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Calling method '.version_select at 0x7f60de4b5870>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2e55d244-7d76-4060-90fe-f853fe449761 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759" status: 204 len: 0 microversion: 2.1 time: 0.129957 Apr 19 13:59:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 13:59:19 2023] DELETE /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-625b5ca3-fb0d-4794-a204-f096daae8b87 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-625b5ca3-fb0d-4794-a204-f096daae8b87 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-363edaeb-34bf-41c2-8e3e-54de129d5372 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] HTTP exception thrown: Volume f709e0cd-0e01-4a1c-9afa-8f701349d2b7 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-363edaeb-34bf-41c2-8e3e-54de129d5372 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Request method failure captured: Apr 19 13:59:19 user devstack@n-api.service[61611]: request: GET /compute/v2.1/os-volumes/f709e0cd-0e01-4a1c-9afa-8f701349d2b7 HTTP/1.1 Apr 19 13:59:19 user devstack@n-api.service[61611]: Accept: application/json Apr 19 13:59:19 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 13:59:19 user devstack@n-api.service[61611]: Connection: close Apr 19 13:59:19 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 13:59:19 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 13:59:19 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 13:59:19 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 13:59:19 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_O23Q9qPvkNzf28woLtxjk40eWvb_yB7Niym-I-ALS24HL07B_DKUqDkynplpmzrNvrYUR1O-UzZOecV-kix964_0UFAzGZLbtvWVOUH2AQexyX7xnGee5-Wzo04HEbleqpOJ39PHWA_hlAKo9qL8s4omW46Z1OUjhG4tRPZa3HEHw Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Project-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a3edb3387c44ef099d0a5f350f4f20e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a3edb3387c44ef099d0a5f350f4f20e"}]}] Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Tenant: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Tenant-Id: 2a3edb3387c44ef099d0a5f350f4f20e Apr 19 13:59:19 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-VolumesNegativeTest-1100121179 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Id: 3667dabf836c411ab7dffd636ab224c3 Apr 19 13:59:19 user devstack@n-api.service[61611]: X-User-Name: tempest-VolumesNegativeTest-1100121179-project-member Apr 19 13:59:19 user devstack@n-api.service[61611]: method: Apr 19 13:59:19 user devstack@n-api.service[61611]: exception: Volume f709e0cd-0e01-4a1c-9afa-8f701349d2b7 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: action_args: {'id': 'f709e0cd-0e01-4a1c-9afa-8f701349d2b7'} Apr 19 13:59:19 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f709e0cd-0e01-4a1c-9afa-8f701349d2b7 could not be found. (HTTP 404) (Request-ID: req-55be20b5-f286-4f9d-8e47-0086ef23496f) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f709e0cd-0e01-4a1c-9afa-8f701349d2b7 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f709e0cd-0e01-4a1c-9afa-8f701349d2b7 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f709e0cd-0e01-4a1c-9afa-8f701349d2b7 could not be found. Apr 19 13:59:19 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-363edaeb-34bf-41c2-8e3e-54de129d5372 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] Returning 404 to user: Volume f709e0cd-0e01-4a1c-9afa-8f701349d2b7 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-363edaeb-34bf-41c2-8e3e-54de129d5372 tempest-VolumesNegativeTest-1100121179 tempest-VolumesNegativeTest-1100121179-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f709e0cd-0e01-4a1c-9afa-8f701349d2b7" status: 404 len: 109 microversion: 2.1 time: 0.050050 Apr 19 13:59:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 57/164] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 13:59:19 2023] GET /compute/v2.1/os-volumes/f709e0cd-0e01-4a1c-9afa-8f701349d2b7 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-625b5ca3-fb0d-4794-a204-f096daae8b87 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-625b5ca3-fb0d-4794-a204-f096daae8b87 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-625b5ca3-fb0d-4794-a204-f096daae8b87 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-625b5ca3-fb0d-4794-a204-f096daae8b87 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-625b5ca3-fb0d-4794-a204-f096daae8b87 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-625b5ca3-fb0d-4794-a204-f096daae8b87 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-9d7b26c1-5f30-487d-8256-878b0eed27ee req-40d256b2-8ec3-4aa4-a335-370061c0d818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c98d2742-2a0f-4004-b3ad-bd387ed40759", "tag": "b595825e-f064-493e-be6d-78cfb50a387a"}, {"server_uuid": "478b7934-6a66-4630-b756-521846ab8230", "name": "network-vif-plugged", "status": "completed", "tag": "8858b70a-e3d6-4655-96a0-864080bd96a9"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-625b5ca3-fb0d-4794-a204-f096daae8b87 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390686e4c10c40f0b1df9b2ba9557484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606afa926de4400819fac2cce6813a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-625b5ca3-fb0d-4794-a204-f096daae8b87 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759" status: 200 len: 1550 microversion: 2.1 time: 0.232267 Apr 19 13:59:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 55/165] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:19 2023] GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759 => generated 1550 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d7b26c1-5f30-487d-8256-878b0eed27ee req-40d256b2-8ec3-4aa4-a335-370061c0d818 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d7b26c1-5f30-487d-8256-878b0eed27ee req-40d256b2-8ec3-4aa4-a335-370061c0d818 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9d7b26c1-5f30-487d-8256-878b0eed27ee req-40d256b2-8ec3-4aa4-a335-370061c0d818 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9d7b26c1-5f30-487d-8256-878b0eed27ee req-40d256b2-8ec3-4aa4-a335-370061c0d818 service nova] Creating event network-changed:b595825e-f064-493e-be6d-78cfb50a387a for instance c98d2742-2a0f-4004-b3ad-bd387ed40759 on user Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9d7b26c1-5f30-487d-8256-878b0eed27ee req-40d256b2-8ec3-4aa4-a335-370061c0d818 service nova] Creating event network-vif-plugged:8858b70a-e3d6-4655-96a0-864080bd96a9 for instance 478b7934-6a66-4630-b756-521846ab8230 on user Apr 19 13:59:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-9d7b26c1-5f30-487d-8256-878b0eed27ee req-40d256b2-8ec3-4aa4-a335-370061c0d818 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098598 Apr 19 13:59:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 58/166] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:19 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-6fc05076-5620-443c-a1c8-1212553d7ce1 req-510da5af-5a89-4f8e-916a-fbc7d5b38337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98d2742-2a0f-4004-b3ad-bd387ed40759", "name": "network-vif-unplugged", "status": "completed", "tag": "b595825e-f064-493e-be6d-78cfb50a387a"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6fc05076-5620-443c-a1c8-1212553d7ce1 req-510da5af-5a89-4f8e-916a-fbc7d5b38337 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6fc05076-5620-443c-a1c8-1212553d7ce1 req-510da5af-5a89-4f8e-916a-fbc7d5b38337 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6fc05076-5620-443c-a1c8-1212553d7ce1 req-510da5af-5a89-4f8e-916a-fbc7d5b38337 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6fc05076-5620-443c-a1c8-1212553d7ce1 req-510da5af-5a89-4f8e-916a-fbc7d5b38337 service nova] Creating event network-vif-unplugged:b595825e-f064-493e-be6d-78cfb50a387a for instance c98d2742-2a0f-4004-b3ad-bd387ed40759 on user Apr 19 13:59:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-6fc05076-5620-443c-a1c8-1212553d7ce1 req-510da5af-5a89-4f8e-916a-fbc7d5b38337 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055325 Apr 19 13:59:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 56/167] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:20 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d6edace9-7516-4b80-ae74-4e99e4581be3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201/action" status: 202 len: 52 microversion: 2.87 time: 1.294340 Apr 19 13:59:20 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 54/168] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 19 13:59:18 2023] POST /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201/action => generated 52 bytes in 1298 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 19 13:59:20 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1234914905", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "032bf858-1d5a-4124-8a42-813b354ac034"}], "security_groups": [{"name": "tempest-securitygroup--1392559604"}], "key_name": "tempest-keypair-824893131", "user_data": "}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:20 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] validate_networks() for [('032bf858-1d5a-4124-8a42-813b354ac034', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Getting quotas for project 8d2b244a7fcf46baab5d636ba6e58fb7. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Getting quotas for user 825cd7cdbfad406197e3230a687dcfcc and project 8d2b244a7fcf46baab5d636ba6e58fb7. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:59:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4803ed6b-5cb3-4858-964b-c2ba18cfb2bb tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.201828 Apr 19 13:59:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 59/169] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 13:59:20 2023] POST /compute/v2.1/servers => generated 400 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 13:59:21 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-673f4cd1-cf8a-4040-a0e6-7343d2bd25a7 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:21 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-673f4cd1-cf8a-4040-a0e6-7343d2bd25a7 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:21 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:21 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-8b366e70-3f19-4491-84de-872e3b95f1b8 req-04c9e927-19a1-4099-8b79-bafa65e9070f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98d2742-2a0f-4004-b3ad-bd387ed40759", "name": "network-vif-plugged", "status": "completed", "tag": "b595825e-f064-493e-be6d-78cfb50a387a"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8b366e70-3f19-4491-84de-872e3b95f1b8 req-04c9e927-19a1-4099-8b79-bafa65e9070f service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8b366e70-3f19-4491-84de-872e3b95f1b8 req-04c9e927-19a1-4099-8b79-bafa65e9070f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-8b366e70-3f19-4491-84de-872e3b95f1b8 req-04c9e927-19a1-4099-8b79-bafa65e9070f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:21 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-673f4cd1-cf8a-4040-a0e6-7343d2bd25a7 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:21 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-673f4cd1-cf8a-4040-a0e6-7343d2bd25a7 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-8b366e70-3f19-4491-84de-872e3b95f1b8 req-04c9e927-19a1-4099-8b79-bafa65e9070f service nova] Creating event network-vif-plugged:b595825e-f064-493e-be6d-78cfb50a387a for instance c98d2742-2a0f-4004-b3ad-bd387ed40759 on user Apr 19 13:59:21 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-673f4cd1-cf8a-4040-a0e6-7343d2bd25a7 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:21 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-673f4cd1-cf8a-4040-a0e6-7343d2bd25a7 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb" status: 200 len: 1275 microversion: 2.20 time: 0.094969 Apr 19 13:59:21 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 57/170] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 13:59:21 2023] GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 13:59:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-8b366e70-3f19-4491-84de-872e3b95f1b8 req-04c9e927-19a1-4099-8b79-bafa65e9070f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045920 Apr 19 13:59:21 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 55/171] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-fa373bd1-ee97-4796-b19e-0a94ccacd7c9 req-b5859b32-0f9a-4b70-9a44-ddd2ed8c00ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98d2742-2a0f-4004-b3ad-bd387ed40759", "name": "network-vif-deleted", "tag": "b595825e-f064-493e-be6d-78cfb50a387a"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fa373bd1-ee97-4796-b19e-0a94ccacd7c9 req-b5859b32-0f9a-4b70-9a44-ddd2ed8c00ee service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fa373bd1-ee97-4796-b19e-0a94ccacd7c9 req-b5859b32-0f9a-4b70-9a44-ddd2ed8c00ee service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fa373bd1-ee97-4796-b19e-0a94ccacd7c9 req-b5859b32-0f9a-4b70-9a44-ddd2ed8c00ee service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-fa373bd1-ee97-4796-b19e-0a94ccacd7c9 req-b5859b32-0f9a-4b70-9a44-ddd2ed8c00ee service nova] Creating event network-vif-deleted:b595825e-f064-493e-be6d-78cfb50a387a for instance c98d2742-2a0f-4004-b3ad-bd387ed40759 on user Apr 19 13:59:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-fa373bd1-ee97-4796-b19e-0a94ccacd7c9 req-b5859b32-0f9a-4b70-9a44-ddd2ed8c00ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037067 Apr 19 13:59:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 60/172] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 7dd44282-31f1-44b8-a8a4-9c7556736201] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:26 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-429bc0d4-d9f4-41f8-af9e-643ca1d95fca tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201" status: 200 len: 1689 microversion: 2.87 time: 0.270877 Apr 19 13:59:26 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 58/173] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 13:59:26 2023] GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201 => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 13:59:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-343a66a9-9d53-40ce-94af-e253c99f1ca1 req-d7be9222-95d6-4b33-8eb1-2228f5b53c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9269f8b-60eb-4cd7-a58d-c34df1d32deb", "tag": "7d8c9040-6fff-4be9-a351-5a49d9ad576c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-343a66a9-9d53-40ce-94af-e253c99f1ca1 req-d7be9222-95d6-4b33-8eb1-2228f5b53c5e service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-343a66a9-9d53-40ce-94af-e253c99f1ca1 req-d7be9222-95d6-4b33-8eb1-2228f5b53c5e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-343a66a9-9d53-40ce-94af-e253c99f1ca1 req-d7be9222-95d6-4b33-8eb1-2228f5b53c5e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-343a66a9-9d53-40ce-94af-e253c99f1ca1 req-d7be9222-95d6-4b33-8eb1-2228f5b53c5e service nova] Creating event network-changed:7d8c9040-6fff-4be9-a351-5a49d9ad576c for instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb on user Apr 19 13:59:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-343a66a9-9d53-40ce-94af-e253c99f1ca1 req-d7be9222-95d6-4b33-8eb1-2228f5b53c5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045269 Apr 19 13:59:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 56/174] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:29 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-1f04418a-f39f-42f9-bc61-1ff569303d93 req-53d3c122-c599-4613-b02c-638361044a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9269f8b-60eb-4cd7-a58d-c34df1d32deb", "name": "network-vif-plugged", "status": "completed", "tag": "7d8c9040-6fff-4be9-a351-5a49d9ad576c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1f04418a-f39f-42f9-bc61-1ff569303d93 req-53d3c122-c599-4613-b02c-638361044a47 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1f04418a-f39f-42f9-bc61-1ff569303d93 req-53d3c122-c599-4613-b02c-638361044a47 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:29 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1f04418a-f39f-42f9-bc61-1ff569303d93 req-53d3c122-c599-4613-b02c-638361044a47 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-1f04418a-f39f-42f9-bc61-1ff569303d93 req-53d3c122-c599-4613-b02c-638361044a47 service nova] Creating event network-vif-plugged:7d8c9040-6fff-4be9-a351-5a49d9ad576c for instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb on user Apr 19 13:59:29 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-1f04418a-f39f-42f9-bc61-1ff569303d93 req-53d3c122-c599-4613-b02c-638361044a47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046301 Apr 19 13:59:29 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 61/175] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:31 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-a8f1482c-bd4f-492a-b426-b8181b3fb4f6 req-74e338ea-8140-460c-9bc5-01ab30503a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9269f8b-60eb-4cd7-a58d-c34df1d32deb", "name": "network-vif-plugged", "status": "completed", "tag": "7d8c9040-6fff-4be9-a351-5a49d9ad576c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a8f1482c-bd4f-492a-b426-b8181b3fb4f6 req-74e338ea-8140-460c-9bc5-01ab30503a27 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a8f1482c-bd4f-492a-b426-b8181b3fb4f6 req-74e338ea-8140-460c-9bc5-01ab30503a27 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:31 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a8f1482c-bd4f-492a-b426-b8181b3fb4f6 req-74e338ea-8140-460c-9bc5-01ab30503a27 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a8f1482c-bd4f-492a-b426-b8181b3fb4f6 req-74e338ea-8140-460c-9bc5-01ab30503a27 service nova] Creating event network-vif-plugged:7d8c9040-6fff-4be9-a351-5a49d9ad576c for instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb on user Apr 19 13:59:31 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-a8f1482c-bd4f-492a-b426-b8181b3fb4f6 req-74e338ea-8140-460c-9bc5-01ab30503a27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032293 Apr 19 13:59:31 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 59/176] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 13:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:33 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9bc277d0-80fd-426c-a073-6c358847a28e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:33 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9bc277d0-80fd-426c-a073-6c358847a28e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: 8744c453-cbe5-46cf-ae39-61dc93058d80] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9bc277d0-80fd-426c-a073-6c358847a28e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9bc277d0-80fd-426c-a073-6c358847a28e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9bc277d0-80fd-426c-a073-6c358847a28e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9bc277d0-80fd-426c-a073-6c358847a28e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9bc277d0-80fd-426c-a073-6c358847a28e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9bc277d0-80fd-426c-a073-6c358847a28e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:33 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-9bc277d0-80fd-426c-a073-6c358847a28e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0088ff4bd64218b490c3414afb1c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b882fb2e40e74c88a69342ca2385b28f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9bc277d0-80fd-426c-a073-6c358847a28e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80" status: 200 len: 1496 microversion: 2.1 time: 0.220279 Apr 19 13:59:33 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 57/177] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:33 2023] GET /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80 => generated 1496 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=16 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=7 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=13 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] [instance: 0b41bbd3-cf76-4be0-8d76-c22496a7fe23] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:46 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] HTTP exception thrown: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Request method failure captured: Apr 19 13:59:46 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23 HTTP/1.1 Apr 19 13:59:46 user devstack@n-api.service[61611]: Accept: application/json Apr 19 13:59:46 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 13:59:46 user devstack@n-api.service[61611]: Connection: close Apr 19 13:59:46 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 13:59:46 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 13:59:46 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 13:59:46 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 13:59:46 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_MN2FyTY79Tm7N4vmJEyXOxm7KwxGYpAug7Vb0M04DpnOlTNUorQKjSh_A92nwZLj55a6qHKdxKep6IeHmWPLdZoEwHjPBnolcgfnfHbOZVzFzEBAjqEfgvLbV3_9BDGnJ27L1phbRXVVXrzBLfQPGWj4cV8-Zc6WCF5TkEeZYA44M Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Project-Id: e0dfe1cb247c4e68bd5dbbe1ccce3100 Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1341535056 Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0dfe1cb247c4e68bd5dbbe1ccce3100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0dfe1cb247c4e68bd5dbbe1ccce3100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e0dfe1cb247c4e68bd5dbbe1ccce3100"}]}] Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1341535056 Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Tenant-Id: e0dfe1cb247c4e68bd5dbbe1ccce3100 Apr 19 13:59:46 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1341535056 Apr 19 13:59:46 user devstack@n-api.service[61611]: X-User: tempest-AttachSCSIVolumeTestJSON-1341535056-project-member Apr 19 13:59:46 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 13:59:46 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 13:59:46 user devstack@n-api.service[61611]: X-User-Id: efd0c03d870041c58e7a857d65e066cc Apr 19 13:59:46 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1341535056-project-member Apr 19 13:59:46 user devstack@n-api.service[61611]: method: > Apr 19 13:59:46 user devstack@n-api.service[61611]: exception: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:46 user devstack@n-api.service[61611]: action_args: {'id': '0b41bbd3-cf76-4be0-8d76-c22496a7fe23'} Apr 19 13:59:46 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:46 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:46 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Returning 404 to user: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:46 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-69c44bb2-ae1c-4c64-8ada-fefcd04319cd tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23" status: 404 len: 111 microversion: 2.1 time: 0.038782 Apr 19 13:59:46 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 62/178] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:46 2023] GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 13:59:46 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:46 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:46 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:46 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c0648d5e-52f2-4479-894a-e6fce9107212 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Calling method '.version_select at 0x7f60de695000>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:46 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c0648d5e-52f2-4479-894a-e6fce9107212 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297891626" status: 202 len: 0 microversion: 2.1 time: 0.042277 Apr 19 13:59:46 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 60/179] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 13:59:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297891626 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] [instance: 0b41bbd3-cf76-4be0-8d76-c22496a7fe23] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] HTTP exception thrown: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Request method failure captured: Apr 19 13:59:48 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23 HTTP/1.1 Apr 19 13:59:48 user devstack@n-api.service[61612]: Accept: application/json Apr 19 13:59:48 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 13:59:48 user devstack@n-api.service[61612]: Connection: close Apr 19 13:59:48 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 13:59:48 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 13:59:48 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 13:59:48 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 13:59:48 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_MN2FyTY79Tm7N4vmJEyXOxm7KwxGYpAug7Vb0M04DpnOlTNUorQKjSh_A92nwZLj55a6qHKdxKep6IeHmWPLdZoEwHjPBnolcgfnfHbOZVzFzEBAjqEfgvLbV3_9BDGnJ27L1phbRXVVXrzBLfQPGWj4cV8-Zc6WCF5TkEeZYA44M Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Project-Id: e0dfe1cb247c4e68bd5dbbe1ccce3100 Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1341535056 Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0dfe1cb247c4e68bd5dbbe1ccce3100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0dfe1cb247c4e68bd5dbbe1ccce3100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e0dfe1cb247c4e68bd5dbbe1ccce3100"}]}] Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1341535056 Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Tenant-Id: e0dfe1cb247c4e68bd5dbbe1ccce3100 Apr 19 13:59:48 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1341535056 Apr 19 13:59:48 user devstack@n-api.service[61612]: X-User: tempest-AttachSCSIVolumeTestJSON-1341535056-project-member Apr 19 13:59:48 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 13:59:48 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 13:59:48 user devstack@n-api.service[61612]: X-User-Id: efd0c03d870041c58e7a857d65e066cc Apr 19 13:59:48 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1341535056-project-member Apr 19 13:59:48 user devstack@n-api.service[61612]: method: > Apr 19 13:59:48 user devstack@n-api.service[61612]: exception: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:48 user devstack@n-api.service[61612]: action_args: {'id': '0b41bbd3-cf76-4be0-8d76-c22496a7fe23'} Apr 19 13:59:48 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:48 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 13:59:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Returning 404 to user: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-2e3e2972-dc58-4041-97d4-d0742c701021 tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23" status: 404 len: 111 microversion: 2.1 time: 0.035504 Apr 19 13:59:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 58/180] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 13:59:48 2023] DELETE /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 13:59:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:48 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] [instance: 0b41bbd3-cf76-4be0-8d76-c22496a7fe23] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] HTTP exception thrown: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Request method failure captured: Apr 19 13:59:48 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23 HTTP/1.1 Apr 19 13:59:48 user devstack@n-api.service[61611]: Accept: application/json Apr 19 13:59:48 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 13:59:48 user devstack@n-api.service[61611]: Connection: close Apr 19 13:59:48 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 13:59:48 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 13:59:48 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 13:59:48 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 13:59:48 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_MN2FyTY79Tm7N4vmJEyXOxm7KwxGYpAug7Vb0M04DpnOlTNUorQKjSh_A92nwZLj55a6qHKdxKep6IeHmWPLdZoEwHjPBnolcgfnfHbOZVzFzEBAjqEfgvLbV3_9BDGnJ27L1phbRXVVXrzBLfQPGWj4cV8-Zc6WCF5TkEeZYA44M Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Project-Id: e0dfe1cb247c4e68bd5dbbe1ccce3100 Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1341535056 Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0dfe1cb247c4e68bd5dbbe1ccce3100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0dfe1cb247c4e68bd5dbbe1ccce3100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e0dfe1cb247c4e68bd5dbbe1ccce3100"}]}] Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1341535056 Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Tenant-Id: e0dfe1cb247c4e68bd5dbbe1ccce3100 Apr 19 13:59:48 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1341535056 Apr 19 13:59:48 user devstack@n-api.service[61611]: X-User: tempest-AttachSCSIVolumeTestJSON-1341535056-project-member Apr 19 13:59:48 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 13:59:48 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 13:59:48 user devstack@n-api.service[61611]: X-User-Id: efd0c03d870041c58e7a857d65e066cc Apr 19 13:59:48 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1341535056-project-member Apr 19 13:59:48 user devstack@n-api.service[61611]: method: > Apr 19 13:59:48 user devstack@n-api.service[61611]: exception: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:48 user devstack@n-api.service[61611]: action_args: {'id': '0b41bbd3-cf76-4be0-8d76-c22496a7fe23'} Apr 19 13:59:48 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. Apr 19 13:59:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 13:59:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] Returning 404 to user: Instance 0b41bbd3-cf76-4be0-8d76-c22496a7fe23 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-61cc4200-eacf-4b06-bcb2-ce65555430fe tempest-AttachSCSIVolumeTestJSON-1341535056 tempest-AttachSCSIVolumeTestJSON-1341535056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23" status: 404 len: 111 microversion: 2.1 time: 0.031995 Apr 19 13:59:48 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 63/181] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:48 2023] GET /compute/v2.1/servers/0b41bbd3-cf76-4be0-8d76-c22496a7fe23 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 13:59:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:55 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 33751f45-cd9e-4b2c-ad4d-1049db7ef555] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] HTTP exception thrown: Instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 could not be found. Apr 19 13:59:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Request method failure captured: Apr 19 13:59:55 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555 HTTP/1.1 Apr 19 13:59:55 user devstack@n-api.service[61613]: Accept: application/json Apr 19 13:59:55 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 13:59:55 user devstack@n-api.service[61613]: Connection: close Apr 19 13:59:55 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 13:59:55 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 13:59:55 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 13:59:55 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 13:59:55 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_MeVcvnulJljy3RtTyUHVWTIVrApm4y8myKCW-7WPm-GojuqHCqg6IZ23yRe8RLyhZOVgdunO6uWvkAaQPauA4Xm6wjsuA_1yAI4J5NkZ_NOy_72k18o0xOf92yjgIKtHY7yTX4Gu2TSYfEwuJOSWJQDt454CsneR4YqKKawvzxcMg Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Project-Id: 833c753ebd4a43f3a70e30069a91f159 Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Project-Name: tempest-TestMinimumBasicScenario-1552925886 Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/833c753ebd4a43f3a70e30069a91f159"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/833c753ebd4a43f3a70e30069a91f159"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/833c753ebd4a43f3a70e30069a91f159"}]}] Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Tenant: tempest-TestMinimumBasicScenario-1552925886 Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Tenant-Id: 833c753ebd4a43f3a70e30069a91f159 Apr 19 13:59:55 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1552925886 Apr 19 13:59:55 user devstack@n-api.service[61613]: X-User: tempest-TestMinimumBasicScenario-1552925886-project-member Apr 19 13:59:55 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 13:59:55 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 13:59:55 user devstack@n-api.service[61613]: X-User-Id: 659c76db8ca8424a8c46a43936dfc7a4 Apr 19 13:59:55 user devstack@n-api.service[61613]: X-User-Name: tempest-TestMinimumBasicScenario-1552925886-project-member Apr 19 13:59:55 user devstack@n-api.service[61613]: method: > Apr 19 13:59:55 user devstack@n-api.service[61613]: exception: Instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 could not be found. Apr 19 13:59:55 user devstack@n-api.service[61613]: action_args: {'id': '33751f45-cd9e-4b2c-ad4d-1049db7ef555'} Apr 19 13:59:55 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 could not be found. Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 could not be found. Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 could not be found. Apr 19 13:59:55 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 13:59:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Returning 404 to user: Instance 33751f45-cd9e-4b2c-ad4d-1049db7ef555 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 13:59:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-53519b6e-e73b-4ee9-9453-170984f56725 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555" status: 404 len: 111 microversion: 2.1 time: 0.035160 Apr 19 13:59:55 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:55 2023] GET /compute/v2.1/servers/33751f45-cd9e-4b2c-ad4d-1049db7ef555 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 13:59:55 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cdfbc90f-b393-478c-857f-91170bd35991 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '.version_select at 0x7f60de4db520>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cdfbc90f-b393-478c-857f-91170bd35991 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1510315384" status: 202 len: 0 microversion: 2.1 time: 0.030271 Apr 19 13:59:55 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 59/183] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 19 13:59:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1510315384 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 13:59:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d73cff7e-2fab-4281-9b82-303d00196205 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Action: 'create', calling method: .version_select at 0x7f60de5e2170>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-667746645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpN5oGph6zjXEqhTdbY1xcgOmbs26KOU1Qo/LL/xx6jL4q0CzpWPjQF/Tfxus+zFaPmLig1vD3+KffUdgsh6LpjEsf5aZeG/7jaDhTP3pnBt4OQWwHFt63EhrPQz8i0Yw=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:58 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-d73cff7e-2fab-4281-9b82-303d00196205 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Getting quotas for project 833c753ebd4a43f3a70e30069a91f159. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:59:58 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-d73cff7e-2fab-4281-9b82-303d00196205 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Getting quotas for user 659c76db8ca8424a8c46a43936dfc7a4 and project 833c753ebd4a43f3a70e30069a91f159. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:59:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d73cff7e-2fab-4281-9b82-303d00196205 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047423 Apr 19 13:59:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 64/184] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 13:59:58 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-811394322", "imageRef": "bdf96e1d-1fd8-4ae7-bd8f-bfd0944a34a4", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-667746645", "networks": [{"uuid": "fa47499b-5227-4a96-b974-d57fa75d62ba"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] validate_networks() for [('fa47499b-5227-4a96-b974-d57fa75d62ba', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Getting quotas for project 833c753ebd4a43f3a70e30069a91f159. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Getting quotas for user 659c76db8ca8424a8c46a43936dfc7a4 and project 833c753ebd4a43f3a70e30069a91f159. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 13:59:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 39b00836-b75e-499d-be70-8a56500a3ebb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdf96e1d-1fd8-4ae7-bd8f-bfd0944a34a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 13:59:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c3382fa8-4b7e-40f6-b2df-45dcc6c865fd tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.607548 Apr 19 13:59:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 62/185] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 13:59:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 13:59:58 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 13:59:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-109d53b4-e975-4a52-b40e-f35388de2685 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 13:59:58 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-109d53b4-e975-4a52-b40e-f35388de2685 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 39b00836-b75e-499d-be70-8a56500a3ebb] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 13:59:58 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-109d53b4-e975-4a52-b40e-f35388de2685 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 13:59:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-109d53b4-e975-4a52-b40e-f35388de2685 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb" status: 200 len: 1251 microversion: 2.1 time: 0.071671 Apr 19 13:59:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 60/186] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 13:59:58 2023] GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb => generated 1251 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:00:01 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-bcf683b8-961a-42ae-b0b7-8bc47f08d822 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:01 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-bcf683b8-961a-42ae-b0b7-8bc47f08d822 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: 478b7934-6a66-4630-b756-521846ab8230] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcf683b8-961a-42ae-b0b7-8bc47f08d822 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcf683b8-961a-42ae-b0b7-8bc47f08d822 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcf683b8-961a-42ae-b0b7-8bc47f08d822 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcf683b8-961a-42ae-b0b7-8bc47f08d822 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcf683b8-961a-42ae-b0b7-8bc47f08d822 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-bcf683b8-961a-42ae-b0b7-8bc47f08d822 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:01 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1810568441", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:01 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] validate_networks() for [('7f2e04f5-2e75-4b8e-8259-455d88b74363', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Getting quotas for project 6d563f8793494ae697180a5f58c11758. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Getting quotas for user b82a409207a14dbd96308936b12a65fa and project 6d563f8793494ae697180a5f58c11758. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: 7c628cf8-58bb-4a59-adc0-929a7ead5e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:00:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-0e95926e-5777-471f-bec5-3a0f1fcc71b2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.676013 Apr 19 14:00:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 63/187] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:00:01 2023] POST /compute/v2.1/servers => generated 381 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:00:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0b45199b-3d26-498f-9144-5342979093bc tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:02 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-0b45199b-3d26-498f-9144-5342979093bc tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: 7c628cf8-58bb-4a59-adc0-929a7ead5e00] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:02 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-0b45199b-3d26-498f-9144-5342979093bc tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b82a409207a14dbd96308936b12a65fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d563f8793494ae697180a5f58c11758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0b45199b-3d26-498f-9144-5342979093bc tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00" status: 200 len: 1216 microversion: 2.1 time: 0.075842 Apr 19 14:00:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 61/188] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:02 2023] GET /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00 => generated 1216 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1613422984", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:02 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] validate_networks() for [('7f2e04f5-2e75-4b8e-8259-455d88b74363', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:00:02 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-bcf683b8-961a-42ae-b0b7-8bc47f08d822 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb00927681348c08cabf5cea1edaac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806255a694c7446893131ff6de13c42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-bcf683b8-961a-42ae-b0b7-8bc47f08d822 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230" status: 200 len: 1494 microversion: 2.1 time: 1.017238 Apr 19 14:00:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 65/189] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:01 2023] GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230 => generated 1494 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:00:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-41ab748c-0505-4970-9414-4ae8d303bf67 req-ccaebac4-a4d4-4411-8e37-3c173896744a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b00836-b75e-499d-be70-8a56500a3ebb", "tag": "ecf78dd9-dbb7-4316-a53a-911bc91656bb"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-41ab748c-0505-4970-9414-4ae8d303bf67 req-ccaebac4-a4d4-4411-8e37-3c173896744a service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-41ab748c-0505-4970-9414-4ae8d303bf67 req-ccaebac4-a4d4-4411-8e37-3c173896744a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-41ab748c-0505-4970-9414-4ae8d303bf67 req-ccaebac4-a4d4-4411-8e37-3c173896744a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-41ab748c-0505-4970-9414-4ae8d303bf67 req-ccaebac4-a4d4-4411-8e37-3c173896744a service nova] Creating event network-changed:ecf78dd9-dbb7-4316-a53a-911bc91656bb for instance 39b00836-b75e-499d-be70-8a56500a3ebb on user Apr 19 14:00:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-41ab748c-0505-4970-9414-4ae8d303bf67 req-ccaebac4-a4d4-4411-8e37-3c173896744a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032327 Apr 19 14:00:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 62/190] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Getting quotas for project 6d563f8793494ae697180a5f58c11758. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Getting quotas for user b82a409207a14dbd96308936b12a65fa and project 6d563f8793494ae697180a5f58c11758. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:00:03 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: f17f6de2-942d-44ab-9d65-ccc1abe92dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:00:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-30f88a20-9a6f-4e46-b3fb-7290f50ff88c tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.866815 Apr 19 14:00:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 64/191] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:00:02 2023] POST /compute/v2.1/servers => generated 381 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:00:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-96d202ab-d023-47fe-a038-cd9d9ac6b0af tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:03 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-96d202ab-d023-47fe-a038-cd9d9ac6b0af tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: f17f6de2-942d-44ab-9d65-ccc1abe92dbb] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:03 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-96d202ab-d023-47fe-a038-cd9d9ac6b0af tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b82a409207a14dbd96308936b12a65fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d563f8793494ae697180a5f58c11758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-96d202ab-d023-47fe-a038-cd9d9ac6b0af tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb" status: 200 len: 1216 microversion: 2.1 time: 0.098180 Apr 19 14:00:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 66/192] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:03 2023] GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb => generated 1216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:00:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-5eb59052-0b87-4522-97a4-d2de7159c34a req-b0544192-8474-4c5f-a83e-334ad21cd9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b00836-b75e-499d-be70-8a56500a3ebb", "name": "network-vif-plugged", "status": "completed", "tag": "ecf78dd9-dbb7-4316-a53a-911bc91656bb"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5eb59052-0b87-4522-97a4-d2de7159c34a req-b0544192-8474-4c5f-a83e-334ad21cd9f2 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5eb59052-0b87-4522-97a4-d2de7159c34a req-b0544192-8474-4c5f-a83e-334ad21cd9f2 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5eb59052-0b87-4522-97a4-d2de7159c34a req-b0544192-8474-4c5f-a83e-334ad21cd9f2 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-5eb59052-0b87-4522-97a4-d2de7159c34a req-b0544192-8474-4c5f-a83e-334ad21cd9f2 service nova] Creating event network-vif-plugged:ecf78dd9-dbb7-4316-a53a-911bc91656bb for instance 39b00836-b75e-499d-be70-8a56500a3ebb on user Apr 19 14:00:05 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-5eb59052-0b87-4522-97a4-d2de7159c34a req-b0544192-8474-4c5f-a83e-334ad21cd9f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 Apr 19 14:00:05 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 63/193] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-ecf22e40-f1e7-495f-a59c-b18d5b7b2f39 req-eb82c28f-92e9-437e-99d0-dc47a4351e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c628cf8-58bb-4a59-adc0-929a7ead5e00", "tag": "26bc9256-e181-4ca9-a223-69c8e86df070"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ecf22e40-f1e7-495f-a59c-b18d5b7b2f39 req-eb82c28f-92e9-437e-99d0-dc47a4351e3f service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ecf22e40-f1e7-495f-a59c-b18d5b7b2f39 req-eb82c28f-92e9-437e-99d0-dc47a4351e3f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-ecf22e40-f1e7-495f-a59c-b18d5b7b2f39 req-eb82c28f-92e9-437e-99d0-dc47a4351e3f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-ecf22e40-f1e7-495f-a59c-b18d5b7b2f39 req-eb82c28f-92e9-437e-99d0-dc47a4351e3f service nova] Creating event network-changed:26bc9256-e181-4ca9-a223-69c8e86df070 for instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 on user Apr 19 14:00:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-ecf22e40-f1e7-495f-a59c-b18d5b7b2f39 req-eb82c28f-92e9-437e-99d0-dc47a4351e3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028620 Apr 19 14:00:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 65/194] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-cb905493-9018-4924-80f0-60efb6894d73 req-f102a3ad-d4c1-4ab6-950a-204f976e59db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b00836-b75e-499d-be70-8a56500a3ebb", "name": "network-vif-plugged", "status": "completed", "tag": "ecf78dd9-dbb7-4316-a53a-911bc91656bb"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cb905493-9018-4924-80f0-60efb6894d73 req-f102a3ad-d4c1-4ab6-950a-204f976e59db service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cb905493-9018-4924-80f0-60efb6894d73 req-f102a3ad-d4c1-4ab6-950a-204f976e59db service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cb905493-9018-4924-80f0-60efb6894d73 req-f102a3ad-d4c1-4ab6-950a-204f976e59db service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-cb905493-9018-4924-80f0-60efb6894d73 req-f102a3ad-d4c1-4ab6-950a-204f976e59db service nova] Creating event network-vif-plugged:ecf78dd9-dbb7-4316-a53a-911bc91656bb for instance 39b00836-b75e-499d-be70-8a56500a3ebb on user Apr 19 14:00:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-cb905493-9018-4924-80f0-60efb6894d73 req-f102a3ad-d4c1-4ab6-950a-204f976e59db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074835 Apr 19 14:00:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 67/195] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-445bf4a9-8cda-403d-96e0-912e04fed717 req-a03c3f0a-5bea-46b8-b3c0-fb99ffb58d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f17f6de2-942d-44ab-9d65-ccc1abe92dbb", "tag": "dd36104d-1964-49d9-8371-84bd895cc49c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-445bf4a9-8cda-403d-96e0-912e04fed717 req-a03c3f0a-5bea-46b8-b3c0-fb99ffb58d4a service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-445bf4a9-8cda-403d-96e0-912e04fed717 req-a03c3f0a-5bea-46b8-b3c0-fb99ffb58d4a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-445bf4a9-8cda-403d-96e0-912e04fed717 req-a03c3f0a-5bea-46b8-b3c0-fb99ffb58d4a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-445bf4a9-8cda-403d-96e0-912e04fed717 req-a03c3f0a-5bea-46b8-b3c0-fb99ffb58d4a service nova] Creating event network-changed:dd36104d-1964-49d9-8371-84bd895cc49c for instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb on user Apr 19 14:00:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-445bf4a9-8cda-403d-96e0-912e04fed717 req-a03c3f0a-5bea-46b8-b3c0-fb99ffb58d4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040302 Apr 19 14:00:08 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 64/196] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-17b36959-e372-4e9f-983f-6ef4665e6a55 req-3664be0f-c41c-408e-899a-4a2f87a50f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c628cf8-58bb-4a59-adc0-929a7ead5e00", "name": "network-vif-plugged", "status": "completed", "tag": "26bc9256-e181-4ca9-a223-69c8e86df070"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-17b36959-e372-4e9f-983f-6ef4665e6a55 req-3664be0f-c41c-408e-899a-4a2f87a50f17 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-17b36959-e372-4e9f-983f-6ef4665e6a55 req-3664be0f-c41c-408e-899a-4a2f87a50f17 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-17b36959-e372-4e9f-983f-6ef4665e6a55 req-3664be0f-c41c-408e-899a-4a2f87a50f17 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-17b36959-e372-4e9f-983f-6ef4665e6a55 req-3664be0f-c41c-408e-899a-4a2f87a50f17 service nova] Creating event network-vif-plugged:26bc9256-e181-4ca9-a223-69c8e86df070 for instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 on user Apr 19 14:00:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-17b36959-e372-4e9f-983f-6ef4665e6a55 req-3664be0f-c41c-408e-899a-4a2f87a50f17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050221 Apr 19 14:00:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 66/197] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:09 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] HTTP exception thrown: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:00:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Request method failure captured: Apr 19 14:00:09 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759 HTTP/1.1 Apr 19 14:00:09 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:00:09 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:00:09 user devstack@n-api.service[61611]: Connection: close Apr 19 14:00:09 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:00:09 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:00:09 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:00:09 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:00:09 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_NCYqdYeIYUtLZia3X7RG-ub8ITKiCDTzHCgD9fyg1v8rPy7Maz_XBa9Ltr7FXuQddz9ilJuL94KrBAHoY6wmfuTcvq82grQEwxnnM7PGCoLxX8Fh26vgvQJJ2ZBuAJleLIQXYGLhNsQLkTaovNY809kdcXqgjHdqBIBDihpUSNPOc Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Project-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0606afa926de4400819fac2cce6813a7"}]}] Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Tenant-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:00:09 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:00:09 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:00:09 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:00:09 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:00:09 user devstack@n-api.service[61611]: X-User-Id: 390686e4c10c40f0b1df9b2ba9557484 Apr 19 14:00:09 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:00:09 user devstack@n-api.service[61611]: method: > Apr 19 14:00:09 user devstack@n-api.service[61611]: exception: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:00:09 user devstack@n-api.service[61611]: action_args: {'id': 'c98d2742-2a0f-4004-b3ad-bd387ed40759'} Apr 19 14:00:09 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:00:09 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:00:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Returning 404 to user: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:00:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ce398679-74f3-4356-ba15-f0aa664a01ea tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759" status: 404 len: 111 microversion: 2.1 time: 0.033330 Apr 19 14:00:09 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 68/198] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:09 2023] GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:00:09 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b59e807d-176b-4887-af01-bc8349adb9f9 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '.version_select at 0x7f60defbd360>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-b59e807d-176b-4887-af01-bc8349adb9f9 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-707300721" status: 202 len: 0 microversion: 2.1 time: 0.022932 Apr 19 14:00:09 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 65/199] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:00:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-707300721 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:00:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-58b62d9f-6ea4-4df0-99ed-3a8a8febf00f req-98f55cd4-3cb6-4b9f-bb43-06a886b07fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17f6de2-942d-44ab-9d65-ccc1abe92dbb", "name": "network-vif-plugged", "status": "completed", "tag": "dd36104d-1964-49d9-8371-84bd895cc49c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-58b62d9f-6ea4-4df0-99ed-3a8a8febf00f req-98f55cd4-3cb6-4b9f-bb43-06a886b07fed service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-58b62d9f-6ea4-4df0-99ed-3a8a8febf00f req-98f55cd4-3cb6-4b9f-bb43-06a886b07fed service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-58b62d9f-6ea4-4df0-99ed-3a8a8febf00f req-98f55cd4-3cb6-4b9f-bb43-06a886b07fed service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-58b62d9f-6ea4-4df0-99ed-3a8a8febf00f req-98f55cd4-3cb6-4b9f-bb43-06a886b07fed service nova] Creating event network-vif-plugged:dd36104d-1964-49d9-8371-84bd895cc49c for instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb on user Apr 19 14:00:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-58b62d9f-6ea4-4df0-99ed-3a8a8febf00f req-98f55cd4-3cb6-4b9f-bb43-06a886b07fed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037070 Apr 19 14:00:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-62503786-cfdc-448d-b045-8fd5ec93fd42 req-91cdc5bc-ee5f-4a26-ba2f-be7e0073d9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c628cf8-58bb-4a59-adc0-929a7ead5e00", "name": "network-vif-plugged", "status": "completed", "tag": "26bc9256-e181-4ca9-a223-69c8e86df070"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-62503786-cfdc-448d-b045-8fd5ec93fd42 req-91cdc5bc-ee5f-4a26-ba2f-be7e0073d9ad service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-62503786-cfdc-448d-b045-8fd5ec93fd42 req-91cdc5bc-ee5f-4a26-ba2f-be7e0073d9ad service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-62503786-cfdc-448d-b045-8fd5ec93fd42 req-91cdc5bc-ee5f-4a26-ba2f-be7e0073d9ad service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-62503786-cfdc-448d-b045-8fd5ec93fd42 req-91cdc5bc-ee5f-4a26-ba2f-be7e0073d9ad service nova] Creating event network-vif-plugged:26bc9256-e181-4ca9-a223-69c8e86df070 for instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 on user Apr 19 14:00:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-62503786-cfdc-448d-b045-8fd5ec93fd42 req-91cdc5bc-ee5f-4a26-ba2f-be7e0073d9ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032997 Apr 19 14:00:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 69/201] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-0cfccf72-649c-4c3e-b5b9-62b9ff08059f tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Action: 'create', calling method: .version_select at 0x7f60de4db9a0>, body: {"keypair": {"name": "tempest-keypair-815914906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcF8eaymNGlF9pO/yZjrGt6JgxsXHuoWWgJ9vbZtNxwCYCxd9WvOg+yiGd6hc+ShM+WoidH977SNvr1t127temwZ/ggFm6tCZEAarxwUuVplEbsn0Baxpo2CeqA8L50Ig=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:10 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-0cfccf72-649c-4c3e-b5b9-62b9ff08059f tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for project 0606afa926de4400819fac2cce6813a7. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:00:10 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-0cfccf72-649c-4c3e-b5b9-62b9ff08059f tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for user 390686e4c10c40f0b1df9b2ba9557484 and project 0606afa926de4400819fac2cce6813a7. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:00:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-0cfccf72-649c-4c3e-b5b9-62b9ff08059f tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055378 Apr 19 14:00:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 66/202] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:00:10 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-999897947", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "eccb12ee-eec2-46f3-bd4b-50363e787f6e"}], "security_groups": [{"name": "tempest-securitygroup--637032073"}], "key_name": "tempest-keypair-815914906", "user_data": "}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:11 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-09791df8-2e4b-4f81-866e-32e94d8c752d req-de647ac5-646a-4794-95bb-12ff0940d4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17f6de2-942d-44ab-9d65-ccc1abe92dbb", "name": "network-vif-plugged", "status": "completed", "tag": "dd36104d-1964-49d9-8371-84bd895cc49c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-09791df8-2e4b-4f81-866e-32e94d8c752d req-de647ac5-646a-4794-95bb-12ff0940d4ba service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-09791df8-2e4b-4f81-866e-32e94d8c752d req-de647ac5-646a-4794-95bb-12ff0940d4ba service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-09791df8-2e4b-4f81-866e-32e94d8c752d req-de647ac5-646a-4794-95bb-12ff0940d4ba service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-09791df8-2e4b-4f81-866e-32e94d8c752d req-de647ac5-646a-4794-95bb-12ff0940d4ba service nova] Creating event network-vif-plugged:dd36104d-1964-49d9-8371-84bd895cc49c for instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb on user Apr 19 14:00:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-09791df8-2e4b-4f81-866e-32e94d8c752d req-de647ac5-646a-4794-95bb-12ff0940d4ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035968 Apr 19 14:00:11 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 67/203] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:11 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1b5c95b1-20eb-4f73-bcf5-827aa70d4f7f tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb" status: 200 len: 1586 microversion: 2.20 time: 0.267258 Apr 19 14:00:11 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 68/204] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:00:11 2023] GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb => generated 1586 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:00:11 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] validate_networks() for [('eccb12ee-eec2-46f3-bd4b-50363e787f6e', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for project 0606afa926de4400819fac2cce6813a7. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for user 390686e4c10c40f0b1df9b2ba9557484 and project 0606afa926de4400819fac2cce6813a7. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:00:12 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:00:12 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3515f70c-eb3b-470a-bf25-fa9a7f16f6d8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.693874 Apr 19 14:00:12 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 70/205] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:00:11 2023] POST /compute/v2.1/servers => generated 399 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:00:12 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-7bf568c7-4f4d-4f93-9b23-43882aa20e54 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:12 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7bf568c7-4f4d-4f93-9b23-43882aa20e54 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:12 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-7bf568c7-4f4d-4f93-9b23-43882aa20e54 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390686e4c10c40f0b1df9b2ba9557484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606afa926de4400819fac2cce6813a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-7bf568c7-4f4d-4f93-9b23-43882aa20e54 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0" status: 200 len: 1234 microversion: 2.1 time: 0.064392 Apr 19 14:00:12 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 68/206] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:12 2023] GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0 => generated 1234 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:00:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-cc1a957c-28a4-40c2-9e00-a30388d9caf5 req-b1c06977-b833-4cfd-9d54-204cd8df8df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f5347a-291b-4d70-a8d9-58ca074f2ed0", "tag": "564734f2-3021-409d-bb40-2cc561379e24"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:15 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:15 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=18 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cc1a957c-28a4-40c2-9e00-a30388d9caf5 req-b1c06977-b833-4cfd-9d54-204cd8df8df0 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cc1a957c-28a4-40c2-9e00-a30388d9caf5 req-b1c06977-b833-4cfd-9d54-204cd8df8df0 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cc1a957c-28a4-40c2-9e00-a30388d9caf5 req-b1c06977-b833-4cfd-9d54-204cd8df8df0 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-cc1a957c-28a4-40c2-9e00-a30388d9caf5 req-b1c06977-b833-4cfd-9d54-204cd8df8df0 service nova] Creating event network-changed:564734f2-3021-409d-bb40-2cc561379e24 for instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 on user Apr 19 14:00:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-cc1a957c-28a4-40c2-9e00-a30388d9caf5 req-b1c06977-b833-4cfd-9d54-204cd8df8df0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043527 Apr 19 14:00:15 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 69/207] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:17 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-04fa5f9b-c535-4e1a-9531-dfb9bdb57fdd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:17 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-04fa5f9b-c535-4e1a-9531-dfb9bdb57fdd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:17 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-04fa5f9b-c535-4e1a-9531-dfb9bdb57fdd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-04fa5f9b-c535-4e1a-9531-dfb9bdb57fdd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-04fa5f9b-c535-4e1a-9531-dfb9bdb57fdd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-04fa5f9b-c535-4e1a-9531-dfb9bdb57fdd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-04fa5f9b-c535-4e1a-9531-dfb9bdb57fdd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:17 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-04fa5f9b-c535-4e1a-9531-dfb9bdb57fdd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:17 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-04fa5f9b-c535-4e1a-9531-dfb9bdb57fdd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3a097ff4d04a0287c417b23d3b00e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f754b42ccea544d4a34e986a6119db51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:17 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-04fa5f9b-c535-4e1a-9531-dfb9bdb57fdd tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f" status: 200 len: 1670 microversion: 2.1 time: 0.208151 Apr 19 14:00:17 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 71/208] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:17 2023] GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f => generated 1670 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:00:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-916800fd-2b26-4cd3-be32-0be4f27d814c req-871f12c6-32c8-4546-834e-8236efdea052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f5347a-291b-4d70-a8d9-58ca074f2ed0", "name": "network-vif-plugged", "status": "completed", "tag": "564734f2-3021-409d-bb40-2cc561379e24"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-916800fd-2b26-4cd3-be32-0be4f27d814c req-871f12c6-32c8-4546-834e-8236efdea052 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-916800fd-2b26-4cd3-be32-0be4f27d814c req-871f12c6-32c8-4546-834e-8236efdea052 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:17 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-916800fd-2b26-4cd3-be32-0be4f27d814c req-871f12c6-32c8-4546-834e-8236efdea052 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-916800fd-2b26-4cd3-be32-0be4f27d814c req-871f12c6-32c8-4546-834e-8236efdea052 service nova] Creating event network-vif-plugged:564734f2-3021-409d-bb40-2cc561379e24 for instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 on user Apr 19 14:00:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-916800fd-2b26-4cd3-be32-0be4f27d814c req-871f12c6-32c8-4546-834e-8236efdea052 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056047 Apr 19 14:00:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 69/209] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-37b45127-5998-4954-bdba-15b9e30d80b5 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '.version_select at 0x7f60de468d30>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-37b45127-5998-4954-bdba-15b9e30d80b5 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/b1a1059c-a29c-435a-aaff-8993a28bfc9d" status: 204 len: 0 microversion: 2.1 time: 0.263907 Apr 19 14:00:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 70/210] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:19 2023] DELETE /compute/v2.1/images/b1a1059c-a29c-435a-aaff-8993a28bfc9d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d2c1d87b-b41a-4b4d-a904-fa64a48fba0c tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d2c1d87b-b41a-4b4d-a904-fa64a48fba0c tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d2c1d87b-b41a-4b4d-a904-fa64a48fba0c tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d2c1d87b-b41a-4b4d-a904-fa64a48fba0c tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d2c1d87b-b41a-4b4d-a904-fa64a48fba0c tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d2c1d87b-b41a-4b4d-a904-fa64a48fba0c tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d2c1d87b-b41a-4b4d-a904-fa64a48fba0c tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d2c1d87b-b41a-4b4d-a904-fa64a48fba0c tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d2c1d87b-b41a-4b4d-a904-fa64a48fba0c tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:00:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d2c1d87b-b41a-4b4d-a904-fa64a48fba0c tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f" status: 204 len: 0 microversion: 2.1 time: 0.134590 Apr 19 14:00:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 72/211] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:00:19 2023] DELETE /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:00:19 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-bc16c7e8-7658-4e90-8b30-49d62b462078 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:19 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-bc16c7e8-7658-4e90-8b30-49d62b462078 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:19 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc16c7e8-7658-4e90-8b30-49d62b462078 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc16c7e8-7658-4e90-8b30-49d62b462078 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc16c7e8-7658-4e90-8b30-49d62b462078 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc16c7e8-7658-4e90-8b30-49d62b462078 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc16c7e8-7658-4e90-8b30-49d62b462078 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-bc16c7e8-7658-4e90-8b30-49d62b462078 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:19 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-d87e2176-345b-4eab-a6d1-1eee0336f3a6 req-236f621c-9e3b-474a-9ecd-d2c12ce01ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f5347a-291b-4d70-a8d9-58ca074f2ed0", "name": "network-vif-plugged", "status": "completed", "tag": "564734f2-3021-409d-bb40-2cc561379e24"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:19 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d87e2176-345b-4eab-a6d1-1eee0336f3a6 req-236f621c-9e3b-474a-9ecd-d2c12ce01ce9 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d87e2176-345b-4eab-a6d1-1eee0336f3a6 req-236f621c-9e3b-474a-9ecd-d2c12ce01ce9 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:19 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d87e2176-345b-4eab-a6d1-1eee0336f3a6 req-236f621c-9e3b-474a-9ecd-d2c12ce01ce9 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:19 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=23 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-d87e2176-345b-4eab-a6d1-1eee0336f3a6 req-236f621c-9e3b-474a-9ecd-d2c12ce01ce9 service nova] Creating event network-vif-plugged:564734f2-3021-409d-bb40-2cc561379e24 for instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 on user Apr 19 14:00:19 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-bc16c7e8-7658-4e90-8b30-49d62b462078 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3a097ff4d04a0287c417b23d3b00e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f754b42ccea544d4a34e986a6119db51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-d87e2176-345b-4eab-a6d1-1eee0336f3a6 req-236f621c-9e3b-474a-9ecd-d2c12ce01ce9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051365 Apr 19 14:00:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 71/212] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-485caecb-ca60-4476-82d1-6f9f1850af18 req-1677ed07-9b48-47f3-9008-e0665433fafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "name": "network-vif-unplugged", "status": "completed", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-485caecb-ca60-4476-82d1-6f9f1850af18 req-1677ed07-9b48-47f3-9008-e0665433fafc service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-485caecb-ca60-4476-82d1-6f9f1850af18 req-1677ed07-9b48-47f3-9008-e0665433fafc service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-485caecb-ca60-4476-82d1-6f9f1850af18 req-1677ed07-9b48-47f3-9008-e0665433fafc service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:19 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-bc16c7e8-7658-4e90-8b30-49d62b462078 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f" status: 200 len: 1676 microversion: 2.1 time: 0.341819 Apr 19 14:00:19 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 70/213] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:19 2023] GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f => generated 1676 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:00:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-485caecb-ca60-4476-82d1-6f9f1850af18 req-1677ed07-9b48-47f3-9008-e0665433fafc service nova] Creating event network-vif-unplugged:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 14:00:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-485caecb-ca60-4476-82d1-6f9f1850af18 req-1677ed07-9b48-47f3-9008-e0665433fafc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048113 Apr 19 14:00:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 73/214] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-84ebdbf4-d516-4f02-a2e7-57ce5ba9cc92 req-0033817d-d1f0-418f-bc69-581a581c96ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "name": "network-vif-plugged", "status": "completed", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}, {"server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "name": "network-vif-plugged", "status": "completed", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}, {"server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "name": "network-vif-plugged", "status": "completed", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}, {"server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "name": "network-vif-unplugged", "status": "completed", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}, {"server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "name": "network-vif-plugged", "status": "completed", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-84ebdbf4-d516-4f02-a2e7-57ce5ba9cc92 req-0033817d-d1f0-418f-bc69-581a581c96ab service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-84ebdbf4-d516-4f02-a2e7-57ce5ba9cc92 req-0033817d-d1f0-418f-bc69-581a581c96ab service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-84ebdbf4-d516-4f02-a2e7-57ce5ba9cc92 req-0033817d-d1f0-418f-bc69-581a581c96ab service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-84ebdbf4-d516-4f02-a2e7-57ce5ba9cc92 req-0033817d-d1f0-418f-bc69-581a581c96ab service nova] Creating event network-vif-plugged:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 14:00:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-84ebdbf4-d516-4f02-a2e7-57ce5ba9cc92 req-0033817d-d1f0-418f-bc69-581a581c96ab service nova] Creating event network-vif-plugged:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 14:00:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-84ebdbf4-d516-4f02-a2e7-57ce5ba9cc92 req-0033817d-d1f0-418f-bc69-581a581c96ab service nova] Creating event network-vif-plugged:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 14:00:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-84ebdbf4-d516-4f02-a2e7-57ce5ba9cc92 req-0033817d-d1f0-418f-bc69-581a581c96ab service nova] Creating event network-vif-unplugged:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 14:00:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-84ebdbf4-d516-4f02-a2e7-57ce5ba9cc92 req-0033817d-d1f0-418f-bc69-581a581c96ab service nova] Creating event network-vif-plugged:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 14:00:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-84ebdbf4-d516-4f02-a2e7-57ce5ba9cc92 req-0033817d-d1f0-418f-bc69-581a581c96ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.038349 Apr 19 14:00:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 72/215] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:22 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:24 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-6a363d9e-d9dd-41ba-b3a7-f1c52cb096b6 req-e37aab95-43d2-49f0-a10d-de104adb66ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f", "name": "network-vif-deleted", "tag": "ab95eda2-d183-4d3f-8095-e275eb92bff7"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:24 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6a363d9e-d9dd-41ba-b3a7-f1c52cb096b6 req-e37aab95-43d2-49f0-a10d-de104adb66ce service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6a363d9e-d9dd-41ba-b3a7-f1c52cb096b6 req-e37aab95-43d2-49f0-a10d-de104adb66ce service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6a363d9e-d9dd-41ba-b3a7-f1c52cb096b6 req-e37aab95-43d2-49f0-a10d-de104adb66ce service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6a363d9e-d9dd-41ba-b3a7-f1c52cb096b6 req-e37aab95-43d2-49f0-a10d-de104adb66ce service nova] Creating event network-vif-deleted:ab95eda2-d183-4d3f-8095-e275eb92bff7 for instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f on user Apr 19 14:00:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-6a363d9e-d9dd-41ba-b3a7-f1c52cb096b6 req-e37aab95-43d2-49f0-a10d-de104adb66ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035579 Apr 19 14:00:24 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 71/216] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:26 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:26 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=12 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-998028918", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "6c5edc8e-b8c1-4e48-bd8d-acf10a103739"}]}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:26 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] validate_networks() for [('6c5edc8e-b8c1-4e48-bd8d-acf10a103739', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Getting quotas for project 2bf567425cb7480e93f114268dc22713. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Getting quotas for user 46f11c11cc4f46e3810f06e974a387c8 and project 2bf567425cb7480e93f114268dc22713. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:00:27 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:00:27 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-12e08fff-31b5-40c8-b30d-3671f2552982 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.946634 Apr 19 14:00:27 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 74/217] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 14:00:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 14:00:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-69f7eb5f-f5f2-475e-85e1-ecbb56516347 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:27 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-69f7eb5f-f5f2-475e-85e1-ecbb56516347 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-69f7eb5f-f5f2-475e-85e1-ecbb56516347 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-69f7eb5f-f5f2-475e-85e1-ecbb56516347 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:27 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-69f7eb5f-f5f2-475e-85e1-ecbb56516347 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-69f7eb5f-f5f2-475e-85e1-ecbb56516347 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8f9b68f-ca77-402c-a026-f75620388888" status: 200 len: 1394 microversion: 2.87 time: 0.083016 Apr 19 14:00:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 73/218] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:00:27 2023] GET /compute/v2.1/servers/d8f9b68f-ca77-402c-a026-f75620388888 => generated 1394 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:00:30 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f79931a2-e792-49a3-b630-e1007319a4ff req-076d82e1-a56f-4cfe-ad33-2b63fa5a0248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f9b68f-ca77-402c-a026-f75620388888", "tag": "2d84fea2-e394-4421-b47c-fc1d19d8cbe0"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f79931a2-e792-49a3-b630-e1007319a4ff req-076d82e1-a56f-4cfe-ad33-2b63fa5a0248 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f79931a2-e792-49a3-b630-e1007319a4ff req-076d82e1-a56f-4cfe-ad33-2b63fa5a0248 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:30 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f79931a2-e792-49a3-b630-e1007319a4ff req-076d82e1-a56f-4cfe-ad33-2b63fa5a0248 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:30 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=19 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f79931a2-e792-49a3-b630-e1007319a4ff req-076d82e1-a56f-4cfe-ad33-2b63fa5a0248 service nova] Creating event network-changed:2d84fea2-e394-4421-b47c-fc1d19d8cbe0 for instance d8f9b68f-ca77-402c-a026-f75620388888 on user Apr 19 14:00:30 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f79931a2-e792-49a3-b630-e1007319a4ff req-076d82e1-a56f-4cfe-ad33-2b63fa5a0248 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038561 Apr 19 14:00:30 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 72/219] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:32 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-988f346a-973f-4ecb-80a6-708a1c62b683 req-79cc1ad7-9934-4528-a98b-d87b34bab992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f9b68f-ca77-402c-a026-f75620388888", "name": "network-vif-deleted", "tag": "2d84fea2-e394-4421-b47c-fc1d19d8cbe0"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-988f346a-973f-4ecb-80a6-708a1c62b683 req-79cc1ad7-9934-4528-a98b-d87b34bab992 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-988f346a-973f-4ecb-80a6-708a1c62b683 req-79cc1ad7-9934-4528-a98b-d87b34bab992 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:32 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-988f346a-973f-4ecb-80a6-708a1c62b683 req-79cc1ad7-9934-4528-a98b-d87b34bab992 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:32 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:32 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.compute.server_external_events [req-988f346a-973f-4ecb-80a6-708a1c62b683 req-79cc1ad7-9934-4528-a98b-d87b34bab992 service nova] Unable to find a host for instance d8f9b68f-ca77-402c-a026-f75620388888. Dropping event network-vif-deleted {{(pid=61611) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 19 14:00:32 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-988f346a-973f-4ecb-80a6-708a1c62b683 req-79cc1ad7-9934-4528-a98b-d87b34bab992 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031989 Apr 19 14:00:32 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 75/220] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:32 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 19 14:00:35 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1b23015a-6c54-43ce-aab2-6d1bd2c8bf5e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:35 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1b23015a-6c54-43ce-aab2-6d1bd2c8bf5e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: 8744c453-cbe5-46cf-ae39-61dc93058d80] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:35 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b23015a-6c54-43ce-aab2-6d1bd2c8bf5e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b23015a-6c54-43ce-aab2-6d1bd2c8bf5e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b23015a-6c54-43ce-aab2-6d1bd2c8bf5e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b23015a-6c54-43ce-aab2-6d1bd2c8bf5e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b23015a-6c54-43ce-aab2-6d1bd2c8bf5e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:35 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1b23015a-6c54-43ce-aab2-6d1bd2c8bf5e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:35 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1b23015a-6c54-43ce-aab2-6d1bd2c8bf5e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: 8744c453-cbe5-46cf-ae39-61dc93058d80] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:00:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1b23015a-6c54-43ce-aab2-6d1bd2c8bf5e tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80" status: 204 len: 0 microversion: 2.1 time: 0.115558 Apr 19 14:00:35 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 74/221] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:00:35 2023] DELETE /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:00:35 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-7b3a2cf3-c437-4a3e-a435-beadcd99aea9 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:35 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7b3a2cf3-c437-4a3e-a435-beadcd99aea9 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: 8744c453-cbe5-46cf-ae39-61dc93058d80] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7b3a2cf3-c437-4a3e-a435-beadcd99aea9 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7b3a2cf3-c437-4a3e-a435-beadcd99aea9 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7b3a2cf3-c437-4a3e-a435-beadcd99aea9 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7b3a2cf3-c437-4a3e-a435-beadcd99aea9 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7b3a2cf3-c437-4a3e-a435-beadcd99aea9 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:35 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7b3a2cf3-c437-4a3e-a435-beadcd99aea9 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-2f51c3bf-ffba-422f-8154-21d5672b93aa req-949d5e9a-9e15-4861-8efd-3cd2efc72bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8744c453-cbe5-46cf-ae39-61dc93058d80", "name": "network-vif-unplugged", "status": "completed", "tag": "435e84d7-a301-4ac0-b69e-ab3e083341d2"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2f51c3bf-ffba-422f-8154-21d5672b93aa req-949d5e9a-9e15-4861-8efd-3cd2efc72bcd service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2f51c3bf-ffba-422f-8154-21d5672b93aa req-949d5e9a-9e15-4861-8efd-3cd2efc72bcd service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-2f51c3bf-ffba-422f-8154-21d5672b93aa req-949d5e9a-9e15-4861-8efd-3cd2efc72bcd service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-2f51c3bf-ffba-422f-8154-21d5672b93aa req-949d5e9a-9e15-4861-8efd-3cd2efc72bcd service nova] Creating event network-vif-unplugged:435e84d7-a301-4ac0-b69e-ab3e083341d2 for instance 8744c453-cbe5-46cf-ae39-61dc93058d80 on user Apr 19 14:00:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-2f51c3bf-ffba-422f-8154-21d5672b93aa req-949d5e9a-9e15-4861-8efd-3cd2efc72bcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029440 Apr 19 14:00:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 76/222] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:35 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-7b3a2cf3-c437-4a3e-a435-beadcd99aea9 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0088ff4bd64218b490c3414afb1c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b882fb2e40e74c88a69342ca2385b28f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:35 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-7b3a2cf3-c437-4a3e-a435-beadcd99aea9 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80" status: 200 len: 1502 microversion: 2.1 time: 0.251849 Apr 19 14:00:35 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 73/223] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:35 2023] GET /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80 => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:00:36 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-8df59a55-6c2c-4cba-b012-42f1b4136b1c req-d73e4880-3ef0-443d-8b0e-f15d76e50493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8744c453-cbe5-46cf-ae39-61dc93058d80", "name": "network-vif-deleted", "tag": "435e84d7-a301-4ac0-b69e-ab3e083341d2"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8df59a55-6c2c-4cba-b012-42f1b4136b1c req-d73e4880-3ef0-443d-8b0e-f15d76e50493 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8df59a55-6c2c-4cba-b012-42f1b4136b1c req-d73e4880-3ef0-443d-8b0e-f15d76e50493 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:36 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-8df59a55-6c2c-4cba-b012-42f1b4136b1c req-d73e4880-3ef0-443d-8b0e-f15d76e50493 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:36 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-8df59a55-6c2c-4cba-b012-42f1b4136b1c req-d73e4880-3ef0-443d-8b0e-f15d76e50493 service nova] Creating event network-vif-deleted:435e84d7-a301-4ac0-b69e-ab3e083341d2 for instance 8744c453-cbe5-46cf-ae39-61dc93058d80 on user Apr 19 14:00:36 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-8df59a55-6c2c-4cba-b012-42f1b4136b1c req-d73e4880-3ef0-443d-8b0e-f15d76e50493 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028661 Apr 19 14:00:36 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 75/224] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:37 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-13d9283e-4f08-44e2-a689-136f3c4682bc req-d1cdbea5-df4b-4d71-b234-db799941e6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8744c453-cbe5-46cf-ae39-61dc93058d80", "name": "network-vif-plugged", "status": "completed", "tag": "435e84d7-a301-4ac0-b69e-ab3e083341d2"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:00:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-13d9283e-4f08-44e2-a689-136f3c4682bc req-d1cdbea5-df4b-4d71-b234-db799941e6f5 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-13d9283e-4f08-44e2-a689-136f3c4682bc req-d1cdbea5-df4b-4d71-b234-db799941e6f5 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:37 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-13d9283e-4f08-44e2-a689-136f3c4682bc req-d1cdbea5-df4b-4d71-b234-db799941e6f5 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:37 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-13d9283e-4f08-44e2-a689-136f3c4682bc req-d1cdbea5-df4b-4d71-b234-db799941e6f5 service nova] Creating event network-vif-plugged:435e84d7-a301-4ac0-b69e-ab3e083341d2 for instance 8744c453-cbe5-46cf-ae39-61dc93058d80 on user Apr 19 14:00:37 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-13d9283e-4f08-44e2-a689-136f3c4682bc req-d1cdbea5-df4b-4d71-b234-db799941e6f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028917 Apr 19 14:00:37 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 77/225] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:00:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-925e8970-029b-475e-b236-fe313730cfaf tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-925e8970-029b-475e-b236-fe313730cfaf tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 39b00836-b75e-499d-be70-8a56500a3ebb] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=7 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=7 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-925e8970-029b-475e-b236-fe313730cfaf tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-925e8970-029b-475e-b236-fe313730cfaf tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-925e8970-029b-475e-b236-fe313730cfaf tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-925e8970-029b-475e-b236-fe313730cfaf tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-925e8970-029b-475e-b236-fe313730cfaf tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-925e8970-029b-475e-b236-fe313730cfaf tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:49 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-925e8970-029b-475e-b236-fe313730cfaf tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-925e8970-029b-475e-b236-fe313730cfaf tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb" status: 200 len: 1535 microversion: 2.1 time: 0.225538 Apr 19 14:00:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 74/226] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:49 2023] GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb => generated 1535 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-074a3400-1c68-4ba9-9813-8167c44b5be5 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-074a3400-1c68-4ba9-9813-8167c44b5be5 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: f17f6de2-942d-44ab-9d65-ccc1abe92dbb] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-074a3400-1c68-4ba9-9813-8167c44b5be5 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-074a3400-1c68-4ba9-9813-8167c44b5be5 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-074a3400-1c68-4ba9-9813-8167c44b5be5 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-074a3400-1c68-4ba9-9813-8167c44b5be5 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-074a3400-1c68-4ba9-9813-8167c44b5be5 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-074a3400-1c68-4ba9-9813-8167c44b5be5 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:00:53 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-074a3400-1c68-4ba9-9813-8167c44b5be5 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b82a409207a14dbd96308936b12a65fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d563f8793494ae697180a5f58c11758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:00:53 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-074a3400-1c68-4ba9-9813-8167c44b5be5 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb" status: 200 len: 1504 microversion: 2.1 time: 0.212869 Apr 19 14:00:53 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 76/227] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:00:53 2023] GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=5 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d65f9ee7-f3b0-4e10-aa02-2b4abd5dc8ae tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d65f9ee7-f3b0-4e10-aa02-2b4abd5dc8ae tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d65f9ee7-f3b0-4e10-aa02-2b4abd5dc8ae tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d65f9ee7-f3b0-4e10-aa02-2b4abd5dc8ae tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d65f9ee7-f3b0-4e10-aa02-2b4abd5dc8ae tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d65f9ee7-f3b0-4e10-aa02-2b4abd5dc8ae tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d65f9ee7-f3b0-4e10-aa02-2b4abd5dc8ae tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d65f9ee7-f3b0-4e10-aa02-2b4abd5dc8ae tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-67f3eaa0-afa7-456b-b7f6-41f66305c365 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-67f3eaa0-afa7-456b-b7f6-41f66305c365 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: 478b7934-6a66-4630-b756-521846ab8230] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-67f3eaa0-afa7-456b-b7f6-41f66305c365 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-67f3eaa0-afa7-456b-b7f6-41f66305c365 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-67f3eaa0-afa7-456b-b7f6-41f66305c365 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-67f3eaa0-afa7-456b-b7f6-41f66305c365 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-67f3eaa0-afa7-456b-b7f6-41f66305c365 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-67f3eaa0-afa7-456b-b7f6-41f66305c365 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:02 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-67f3eaa0-afa7-456b-b7f6-41f66305c365 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: 478b7934-6a66-4630-b756-521846ab8230] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:01:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-67f3eaa0-afa7-456b-b7f6-41f66305c365 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230" status: 204 len: 0 microversion: 2.1 time: 0.228329 Apr 19 14:01:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 75/228] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:01:02 2023] DELETE /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:01:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cd6b6133-97f9-4e3b-8e26-0504a7a88fea tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:02 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-cd6b6133-97f9-4e3b-8e26-0504a7a88fea tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: 478b7934-6a66-4630-b756-521846ab8230] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cd6b6133-97f9-4e3b-8e26-0504a7a88fea tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cd6b6133-97f9-4e3b-8e26-0504a7a88fea tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cd6b6133-97f9-4e3b-8e26-0504a7a88fea tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cd6b6133-97f9-4e3b-8e26-0504a7a88fea tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cd6b6133-97f9-4e3b-8e26-0504a7a88fea tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cd6b6133-97f9-4e3b-8e26-0504a7a88fea tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:02 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-d65f9ee7-f3b0-4e10-aa02-2b4abd5dc8ae tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390686e4c10c40f0b1df9b2ba9557484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606afa926de4400819fac2cce6813a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d65f9ee7-f3b0-4e10-aa02-2b4abd5dc8ae tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0" status: 200 len: 1543 microversion: 2.1 time: 0.269435 Apr 19 14:01:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 78/229] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:02 2023] GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0 => generated 1543 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:01:03 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-cd6b6133-97f9-4e3b-8e26-0504a7a88fea tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb00927681348c08cabf5cea1edaac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806255a694c7446893131ff6de13c42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:03 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-5b650e22-33f9-438f-9c49-0f13ca79f2b6 req-89976174-005e-4ecf-9710-6ccdcfc8f73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478b7934-6a66-4630-b756-521846ab8230", "name": "network-vif-unplugged", "status": "completed", "tag": "8858b70a-e3d6-4655-96a0-864080bd96a9"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:03 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-cd6b6133-97f9-4e3b-8e26-0504a7a88fea tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230" status: 200 len: 1500 microversion: 2.1 time: 0.248974 Apr 19 14:01:03 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 77/230] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:02 2023] GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230 => generated 1500 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:01:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5b650e22-33f9-438f-9c49-0f13ca79f2b6 req-89976174-005e-4ecf-9710-6ccdcfc8f73d service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5b650e22-33f9-438f-9c49-0f13ca79f2b6 req-89976174-005e-4ecf-9710-6ccdcfc8f73d service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:03 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5b650e22-33f9-438f-9c49-0f13ca79f2b6 req-89976174-005e-4ecf-9710-6ccdcfc8f73d service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-5b650e22-33f9-438f-9c49-0f13ca79f2b6 req-89976174-005e-4ecf-9710-6ccdcfc8f73d service nova] Creating event network-vif-unplugged:8858b70a-e3d6-4655-96a0-864080bd96a9 for instance 478b7934-6a66-4630-b756-521846ab8230 on user Apr 19 14:01:03 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-5b650e22-33f9-438f-9c49-0f13ca79f2b6 req-89976174-005e-4ecf-9710-6ccdcfc8f73d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034358 Apr 19 14:01:03 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 76/231] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:04 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-b26e7640-5811-4fef-9caf-989abc67c8cd req-0f0b6fab-a942-4e6b-941c-31e456d42b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478b7934-6a66-4630-b756-521846ab8230", "name": "network-vif-deleted", "tag": "8858b70a-e3d6-4655-96a0-864080bd96a9"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b26e7640-5811-4fef-9caf-989abc67c8cd req-0f0b6fab-a942-4e6b-941c-31e456d42b93 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b26e7640-5811-4fef-9caf-989abc67c8cd req-0f0b6fab-a942-4e6b-941c-31e456d42b93 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:04 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-b26e7640-5811-4fef-9caf-989abc67c8cd req-0f0b6fab-a942-4e6b-941c-31e456d42b93 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-b26e7640-5811-4fef-9caf-989abc67c8cd req-0f0b6fab-a942-4e6b-941c-31e456d42b93 service nova] Creating event network-vif-deleted:8858b70a-e3d6-4655-96a0-864080bd96a9 for instance 478b7934-6a66-4630-b756-521846ab8230 on user Apr 19 14:01:04 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-b26e7640-5811-4fef-9caf-989abc67c8cd req-0f0b6fab-a942-4e6b-941c-31e456d42b93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030689 Apr 19 14:01:04 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 79/232] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-316c9401-2bf2-4216-8bc7-4500d559fe9a req-6ac2d111-075e-45f5-a363-6ddabc818ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478b7934-6a66-4630-b756-521846ab8230", "name": "network-vif-plugged", "status": "completed", "tag": "8858b70a-e3d6-4655-96a0-864080bd96a9"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-316c9401-2bf2-4216-8bc7-4500d559fe9a req-6ac2d111-075e-45f5-a363-6ddabc818ebf service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-316c9401-2bf2-4216-8bc7-4500d559fe9a req-6ac2d111-075e-45f5-a363-6ddabc818ebf service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-316c9401-2bf2-4216-8bc7-4500d559fe9a req-6ac2d111-075e-45f5-a363-6ddabc818ebf service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-316c9401-2bf2-4216-8bc7-4500d559fe9a req-6ac2d111-075e-45f5-a363-6ddabc818ebf service nova] Creating event network-vif-plugged:8858b70a-e3d6-4655-96a0-864080bd96a9 for instance 478b7934-6a66-4630-b756-521846ab8230 on user Apr 19 14:01:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-316c9401-2bf2-4216-8bc7-4500d559fe9a req-6ac2d111-075e-45f5-a363-6ddabc818ebf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027405 Apr 19 14:01:05 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 78/233] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:10 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] [instance: d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] HTTP exception thrown: Instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f could not be found. Apr 19 14:01:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Request method failure captured: Apr 19 14:01:10 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f HTTP/1.1 Apr 19 14:01:10 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:01:10 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:01:10 user devstack@n-api.service[61612]: Connection: close Apr 19 14:01:10 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:01:10 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:01:10 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:01:10 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:01:10 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_MFINyJxdl60qtaBZhILXzv0aiHxtvGd-p0ksoXGjftA5LJlAiiurdnX4xTNmwEUWJ3fFEdzzYayiXCZTK1wJmFWNMDLOmn8aZY973Wqgfr30EmCwYXm8VIVtAdb3MWYYkBOooNwTkkrB9cC_hg6WKK9o7-dXYEShTESchKZ_rzWZM Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Project-Id: f754b42ccea544d4a34e986a6119db51 Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerStableDeviceRescueTest-357701394 Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f754b42ccea544d4a34e986a6119db51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f754b42ccea544d4a34e986a6119db51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f754b42ccea544d4a34e986a6119db51"}]}] Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerStableDeviceRescueTest-357701394 Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Tenant-Id: f754b42ccea544d4a34e986a6119db51 Apr 19 14:01:10 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-357701394 Apr 19 14:01:10 user devstack@n-api.service[61612]: X-User: tempest-ServerStableDeviceRescueTest-357701394-project-member Apr 19 14:01:10 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:01:10 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:01:10 user devstack@n-api.service[61612]: X-User-Id: af3a097ff4d04a0287c417b23d3b00e4 Apr 19 14:01:10 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerStableDeviceRescueTest-357701394-project-member Apr 19 14:01:10 user devstack@n-api.service[61612]: method: > Apr 19 14:01:10 user devstack@n-api.service[61612]: exception: Instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f could not be found. Apr 19 14:01:10 user devstack@n-api.service[61612]: action_args: {'id': 'd4aa9fc7-62d7-4d13-9722-9b1c914e5d2f'} Apr 19 14:01:10 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f could not be found. Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f could not be found. Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f could not be found. Apr 19 14:01:10 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:01:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Returning 404 to user: Instance d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:01:10 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-aabe3c2d-dee1-4543-8337-3823ca9f6076 tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f" status: 404 len: 111 microversion: 2.1 time: 0.039306 Apr 19 14:01:10 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 77/234] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:10 2023] GET /compute/v2.1/servers/d4aa9fc7-62d7-4d13-9722-9b1c914e5d2f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:01:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-51dec19e-976d-4371-bde6-aa235750e58e tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] Calling method '.version_select at 0x7f60de5e23b0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-51dec19e-976d-4371-bde6-aa235750e58e tempest-ServerStableDeviceRescueTest-357701394 tempest-ServerStableDeviceRescueTest-357701394-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-800659709" status: 202 len: 0 microversion: 2.1 time: 0.024743 Apr 19 14:01:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 80/235] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:01:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-800659709 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:01:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b6f8ffb9-d817-4d22-b5e6-f644fbe2a2b3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:12 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b6f8ffb9-d817-4d22-b5e6-f644fbe2a2b3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b6f8ffb9-d817-4d22-b5e6-f644fbe2a2b3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b6f8ffb9-d817-4d22-b5e6-f644fbe2a2b3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b6f8ffb9-d817-4d22-b5e6-f644fbe2a2b3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b6f8ffb9-d817-4d22-b5e6-f644fbe2a2b3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b6f8ffb9-d817-4d22-b5e6-f644fbe2a2b3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:12 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b6f8ffb9-d817-4d22-b5e6-f644fbe2a2b3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b6f8ffb9-d817-4d22-b5e6-f644fbe2a2b3 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.311865 Apr 19 14:01:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 79/236] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 19 14:01:11 2023] GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb/os-interface => generated 283 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:01:13 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-9f7c283a-7ef5-4535-a5ee-52c2d6679505 req-3377a4f9-c5e2-43cc-afdc-d3b8c3038212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9269f8b-60eb-4cd7-a58d-c34df1d32deb", "tag": "7d8c9040-6fff-4be9-a351-5a49d9ad576c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9f7c283a-7ef5-4535-a5ee-52c2d6679505 req-3377a4f9-c5e2-43cc-afdc-d3b8c3038212 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9f7c283a-7ef5-4535-a5ee-52c2d6679505 req-3377a4f9-c5e2-43cc-afdc-d3b8c3038212 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:13 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-9f7c283a-7ef5-4535-a5ee-52c2d6679505 req-3377a4f9-c5e2-43cc-afdc-d3b8c3038212 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-9f7c283a-7ef5-4535-a5ee-52c2d6679505 req-3377a4f9-c5e2-43cc-afdc-d3b8c3038212 service nova] Creating event network-changed:7d8c9040-6fff-4be9-a351-5a49d9ad576c for instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb on user Apr 19 14:01:13 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-9f7c283a-7ef5-4535-a5ee-52c2d6679505 req-3377a4f9-c5e2-43cc-afdc-d3b8c3038212 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032284 Apr 19 14:01:13 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 78/237] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:13 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-2aeb52f8-06e0-4302-a824-fd2eaafcc276 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:13 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-2aeb52f8-06e0-4302-a824-fd2eaafcc276 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2aeb52f8-06e0-4302-a824-fd2eaafcc276 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2aeb52f8-06e0-4302-a824-fd2eaafcc276 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2aeb52f8-06e0-4302-a824-fd2eaafcc276 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2aeb52f8-06e0-4302-a824-fd2eaafcc276 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2aeb52f8-06e0-4302-a824-fd2eaafcc276 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:13 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-2aeb52f8-06e0-4302-a824-fd2eaafcc276 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:13 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-2aeb52f8-06e0-4302-a824-fd2eaafcc276 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb/ips" status: 200 len: 109 microversion: 2.20 time: 0.052575 Apr 19 14:01:13 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 81/238] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 19 14:01:13 2023] GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb/ips => generated 109 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 14:01:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-0a0884a7-49c9-47b3-acf0-6ca6eee0d6a5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:15 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0a0884a7-49c9-47b3-acf0-6ca6eee0d6a5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0a0884a7-49c9-47b3-acf0-6ca6eee0d6a5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0a0884a7-49c9-47b3-acf0-6ca6eee0d6a5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0a0884a7-49c9-47b3-acf0-6ca6eee0d6a5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0a0884a7-49c9-47b3-acf0-6ca6eee0d6a5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0a0884a7-49c9-47b3-acf0-6ca6eee0d6a5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:15 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-0a0884a7-49c9-47b3-acf0-6ca6eee0d6a5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:15 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-0a0884a7-49c9-47b3-acf0-6ca6eee0d6a5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:01:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-0a0884a7-49c9-47b3-acf0-6ca6eee0d6a5 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb" status: 204 len: 0 microversion: 2.20 time: 0.110994 Apr 19 14:01:15 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 80/239] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:01:15 2023] DELETE /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:15 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825cd7cdbfad406197e3230a687dcfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2b244a7fcf46baab5d636ba6e58fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d7d0ae84-ca65-457b-9e6b-443b3cb56488 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb" status: 200 len: 1711 microversion: 2.20 time: 0.197047 Apr 19 14:01:15 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 79/240] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:01:15 2023] GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb => generated 1711 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:01:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-6692a957-3635-4fc2-a4e9-2dbfb8017af5 req-2b2aee69-26b0-4740-a2c0-4cd83bf441f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9269f8b-60eb-4cd7-a58d-c34df1d32deb", "name": "network-vif-unplugged", "status": "completed", "tag": "7d8c9040-6fff-4be9-a351-5a49d9ad576c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6692a957-3635-4fc2-a4e9-2dbfb8017af5 req-2b2aee69-26b0-4740-a2c0-4cd83bf441f7 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6692a957-3635-4fc2-a4e9-2dbfb8017af5 req-2b2aee69-26b0-4740-a2c0-4cd83bf441f7 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-6692a957-3635-4fc2-a4e9-2dbfb8017af5 req-2b2aee69-26b0-4740-a2c0-4cd83bf441f7 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-6692a957-3635-4fc2-a4e9-2dbfb8017af5 req-2b2aee69-26b0-4740-a2c0-4cd83bf441f7 service nova] Creating event network-vif-unplugged:7d8c9040-6fff-4be9-a351-5a49d9ad576c for instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb on user Apr 19 14:01:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-6692a957-3635-4fc2-a4e9-2dbfb8017af5 req-2b2aee69-26b0-4740-a2c0-4cd83bf441f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031381 Apr 19 14:01:15 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 82/241] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:17 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-cf17be4b-2723-441f-b470-cb85e6360387 req-e27a4442-bcc9-4d50-b04e-e73dd72f81c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9269f8b-60eb-4cd7-a58d-c34df1d32deb", "name": "network-vif-plugged", "status": "completed", "tag": "7d8c9040-6fff-4be9-a351-5a49d9ad576c"}, {"server_uuid": "f9269f8b-60eb-4cd7-a58d-c34df1d32deb", "name": "network-vif-deleted", "tag": "7d8c9040-6fff-4be9-a351-5a49d9ad576c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cf17be4b-2723-441f-b470-cb85e6360387 req-e27a4442-bcc9-4d50-b04e-e73dd72f81c0 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cf17be4b-2723-441f-b470-cb85e6360387 req-e27a4442-bcc9-4d50-b04e-e73dd72f81c0 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cf17be4b-2723-441f-b470-cb85e6360387 req-e27a4442-bcc9-4d50-b04e-e73dd72f81c0 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-cf17be4b-2723-441f-b470-cb85e6360387 req-e27a4442-bcc9-4d50-b04e-e73dd72f81c0 service nova] Creating event network-vif-plugged:7d8c9040-6fff-4be9-a351-5a49d9ad576c for instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb on user Apr 19 14:01:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-cf17be4b-2723-441f-b470-cb85e6360387 req-e27a4442-bcc9-4d50-b04e-e73dd72f81c0 service nova] Creating event network-vif-deleted:7d8c9040-6fff-4be9-a351-5a49d9ad576c for instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb on user Apr 19 14:01:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-cf17be4b-2723-441f-b470-cb85e6360387 req-e27a4442-bcc9-4d50-b04e-e73dd72f81c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032806 Apr 19 14:01:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 81/242] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lazy-loading 'fault' on Instance uuid d8f9b68f-ca77-402c-a026-f75620388888 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-8dfb07ce-c17c-45e2-92bf-7b010406da62 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8f9b68f-ca77-402c-a026-f75620388888" status: 200 len: 1649 microversion: 2.87 time: 0.172909 Apr 19 14:01:18 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 80/243] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:01:17 2023] GET /compute/v2.1/servers/d8f9b68f-ca77-402c-a026-f75620388888 => generated 1649 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] Doing local delete in cell 2620343c-c8d1-48e6-ac23-7775ee8493ea(cell1) {{(pid=61611) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:18 user devstack@n-api.service[61611]: WARNING nova.compute.api [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] instance's host None is down, deleting from database Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] deallocate_for_instance() {{(pid=61611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] Instance cache missing network info. {{(pid=61611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] Updating instance_info_cache with network_info: [] {{(pid=61611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 19 14:01:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61611) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 19 14:01:18 user devstack@n-api.service[61611]: WARNING nova.compute.api [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 19 14:01:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d0fa20bc-5c13-4098-bd7f-7d287ea46f44 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8f9b68f-ca77-402c-a026-f75620388888" status: 204 len: 0 microversion: 2.87 time: 0.558111 Apr 19 14:01:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 83/244] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:01:18 2023] DELETE /compute/v2.1/servers/d8f9b68f-ca77-402c-a026-f75620388888 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 14:01:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:18 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: d8f9b68f-ca77-402c-a026-f75620388888] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] HTTP exception thrown: Instance d8f9b68f-ca77-402c-a026-f75620388888 could not be found. Apr 19 14:01:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Request method failure captured: Apr 19 14:01:18 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/d8f9b68f-ca77-402c-a026-f75620388888 HTTP/1.1 Apr 19 14:01:18 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:01:18 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:01:18 user devstack@n-api.service[61613]: Connection: close Apr 19 14:01:18 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:01:18 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:01:18 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:01:18 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:01:18 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_NH9TxQ-AlgSG8fcsUjQ3kA9xtDSUjM-NMnFsny7ZG-UVjg-B4v1X-HPHooMNSE0t31PxlO2nZ6Qq6_el7ctQwVs6UlFW86AWP38_Jo3ktdXabUQhXzf_zJZOVF1kBfJ-TMSGj52EIcIIyMtwaF1ZZdkE7_Tm4b0i6OMGMnX2NgxCM Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Project-Id: 2bf567425cb7480e93f114268dc22713 Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bf567425cb7480e93f114268dc22713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bf567425cb7480e93f114268dc22713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2bf567425cb7480e93f114268dc22713"}]}] Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Tenant-Id: 2bf567425cb7480e93f114268dc22713 Apr 19 14:01:18 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:01:18 user devstack@n-api.service[61613]: X-User: tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member Apr 19 14:01:18 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:01:18 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:01:18 user devstack@n-api.service[61613]: X-User-Id: 46f11c11cc4f46e3810f06e974a387c8 Apr 19 14:01:18 user devstack@n-api.service[61613]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member Apr 19 14:01:18 user devstack@n-api.service[61613]: method: > Apr 19 14:01:18 user devstack@n-api.service[61613]: exception: Instance d8f9b68f-ca77-402c-a026-f75620388888 could not be found. Apr 19 14:01:18 user devstack@n-api.service[61613]: action_args: {'id': 'd8f9b68f-ca77-402c-a026-f75620388888'} Apr 19 14:01:18 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f9b68f-ca77-402c-a026-f75620388888 could not be found. Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f9b68f-ca77-402c-a026-f75620388888 could not be found. Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f9b68f-ca77-402c-a026-f75620388888 could not be found. Apr 19 14:01:18 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:01:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Returning 404 to user: Instance d8f9b68f-ca77-402c-a026-f75620388888 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:01:18 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-a9a4e731-6b4a-4d69-85cf-e5f6cb9f37c3 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8f9b68f-ca77-402c-a026-f75620388888" status: 404 len: 111 microversion: 2.87 time: 0.031106 Apr 19 14:01:18 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 82/245] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:01:18 2023] GET /compute/v2.1/servers/d8f9b68f-ca77-402c-a026-f75620388888 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-828838196", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "networks": [{"uuid": "6c5edc8e-b8c1-4e48-bd8d-acf10a103739"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:18 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] validate_networks() for [('6c5edc8e-b8c1-4e48-bd8d-acf10a103739', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Getting quotas for project 2bf567425cb7480e93f114268dc22713. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Getting quotas for user 46f11c11cc4f46e3810f06e974a387c8 and project 2bf567425cb7480e93f114268dc22713. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:01:19 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 547f7955-94c5-48e4-8705-456f5d4c2d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:01:19 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-a9959dfd-8db5-4d5c-b60a-a66ad1353cef tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.559986 Apr 19 14:01:19 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 81/246] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 14:01:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 14:01:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-54af65fa-d5de-4c8e-80e8-35a01887cfbf tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:19 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-54af65fa-d5de-4c8e-80e8-35a01887cfbf tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 547f7955-94c5-48e4-8705-456f5d4c2d99] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:19 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-54af65fa-d5de-4c8e-80e8-35a01887cfbf tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:19 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-54af65fa-d5de-4c8e-80e8-35a01887cfbf tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:19 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-54af65fa-d5de-4c8e-80e8-35a01887cfbf tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-54af65fa-d5de-4c8e-80e8-35a01887cfbf tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99" status: 200 len: 1394 microversion: 2.87 time: 0.082062 Apr 19 14:01:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 84/247] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:01:19 2023] GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99 => generated 1394 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:01:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-df0642fe-1f62-4828-ac76-e91ca294ea6d req-871ec5d6-32b9-42d6-97d1-ab8ad82e0480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547f7955-94c5-48e4-8705-456f5d4c2d99", "tag": "2eb1b519-4623-46ca-90c7-9ed496dcae15"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-df0642fe-1f62-4828-ac76-e91ca294ea6d req-871ec5d6-32b9-42d6-97d1-ab8ad82e0480 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-df0642fe-1f62-4828-ac76-e91ca294ea6d req-871ec5d6-32b9-42d6-97d1-ab8ad82e0480 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-df0642fe-1f62-4828-ac76-e91ca294ea6d req-871ec5d6-32b9-42d6-97d1-ab8ad82e0480 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-df0642fe-1f62-4828-ac76-e91ca294ea6d req-871ec5d6-32b9-42d6-97d1-ab8ad82e0480 service nova] Creating event network-changed:2eb1b519-4623-46ca-90c7-9ed496dcae15 for instance 547f7955-94c5-48e4-8705-456f5d4c2d99 on user Apr 19 14:01:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-df0642fe-1f62-4828-ac76-e91ca294ea6d req-871ec5d6-32b9-42d6-97d1-ab8ad82e0480 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036684 Apr 19 14:01:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 83/248] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:24 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-c0e202aa-74d0-4cbe-9aaf-ecbe4e622007 req-2fde03f8-4273-4077-8d44-cd33b5728038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547f7955-94c5-48e4-8705-456f5d4c2d99", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1b519-4623-46ca-90c7-9ed496dcae15"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c0e202aa-74d0-4cbe-9aaf-ecbe4e622007 req-2fde03f8-4273-4077-8d44-cd33b5728038 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c0e202aa-74d0-4cbe-9aaf-ecbe4e622007 req-2fde03f8-4273-4077-8d44-cd33b5728038 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c0e202aa-74d0-4cbe-9aaf-ecbe4e622007 req-2fde03f8-4273-4077-8d44-cd33b5728038 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-c0e202aa-74d0-4cbe-9aaf-ecbe4e622007 req-2fde03f8-4273-4077-8d44-cd33b5728038 service nova] Creating event network-vif-plugged:2eb1b519-4623-46ca-90c7-9ed496dcae15 for instance 547f7955-94c5-48e4-8705-456f5d4c2d99 on user Apr 19 14:01:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-c0e202aa-74d0-4cbe-9aaf-ecbe4e622007 req-2fde03f8-4273-4077-8d44-cd33b5728038 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080090 Apr 19 14:01:24 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 82/249] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:25 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:25 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: 8744c453-cbe5-46cf-ae39-61dc93058d80] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] HTTP exception thrown: Instance 8744c453-cbe5-46cf-ae39-61dc93058d80 could not be found. Apr 19 14:01:25 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Request method failure captured: Apr 19 14:01:25 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80 HTTP/1.1 Apr 19 14:01:25 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:01:25 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:01:25 user devstack@n-api.service[61611]: Connection: close Apr 19 14:01:25 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:01:25 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:01:25 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:01:25 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:01:25 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_L-R6bBayCMCix6c0HJh4JP8dlvNvMuvFj3jX0KbveQfwl_XJ63eUktYLThf9EhjsaqoF5Eh9NfBPL9uVV8LZXeYdzYnCuj7uKzt1MQUK5r2IBYudPVyXJ-6Ta-RKXWMfPcEuXF5AmnjagCcz3JWQissu4S8sJvcQE_8afVv7mq2dQ Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Project-Id: b882fb2e40e74c88a69342ca2385b28f Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Project-Name: tempest-VolumesAdminNegativeTest-1313568547 Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b882fb2e40e74c88a69342ca2385b28f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b882fb2e40e74c88a69342ca2385b28f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b882fb2e40e74c88a69342ca2385b28f"}]}] Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Tenant: tempest-VolumesAdminNegativeTest-1313568547 Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Tenant-Id: b882fb2e40e74c88a69342ca2385b28f Apr 19 14:01:25 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1313568547 Apr 19 14:01:25 user devstack@n-api.service[61611]: X-User: tempest-VolumesAdminNegativeTest-1313568547-project-member Apr 19 14:01:25 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:01:25 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:01:25 user devstack@n-api.service[61611]: X-User-Id: ee0088ff4bd64218b490c3414afb1c76 Apr 19 14:01:25 user devstack@n-api.service[61611]: X-User-Name: tempest-VolumesAdminNegativeTest-1313568547-project-member Apr 19 14:01:25 user devstack@n-api.service[61611]: method: > Apr 19 14:01:25 user devstack@n-api.service[61611]: exception: Instance 8744c453-cbe5-46cf-ae39-61dc93058d80 could not be found. Apr 19 14:01:25 user devstack@n-api.service[61611]: action_args: {'id': '8744c453-cbe5-46cf-ae39-61dc93058d80'} Apr 19 14:01:25 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8744c453-cbe5-46cf-ae39-61dc93058d80 could not be found. Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8744c453-cbe5-46cf-ae39-61dc93058d80 could not be found. Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8744c453-cbe5-46cf-ae39-61dc93058d80 could not be found. Apr 19 14:01:25 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:01:25 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Returning 404 to user: Instance 8744c453-cbe5-46cf-ae39-61dc93058d80 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:01:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-b2a1f630-9f5c-4852-a9f0-400abea9a59a tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80" status: 404 len: 111 microversion: 2.1 time: 0.030764 Apr 19 14:01:25 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 85/250] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:25 2023] GET /compute/v2.1/servers/8744c453-cbe5-46cf-ae39-61dc93058d80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-8cad93d2-9aa2-4499-80b2-a85baaf814fb tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8cad93d2-9aa2-4499-80b2-a85baaf814fb tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: dee689b0-177a-4265-a296-c75cd57e74ba] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cad93d2-9aa2-4499-80b2-a85baaf814fb tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cad93d2-9aa2-4499-80b2-a85baaf814fb tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cad93d2-9aa2-4499-80b2-a85baaf814fb tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cad93d2-9aa2-4499-80b2-a85baaf814fb tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cad93d2-9aa2-4499-80b2-a85baaf814fb tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-8cad93d2-9aa2-4499-80b2-a85baaf814fb tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:25 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-8cad93d2-9aa2-4499-80b2-a85baaf814fb tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: dee689b0-177a-4265-a296-c75cd57e74ba] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:01:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-8cad93d2-9aa2-4499-80b2-a85baaf814fb tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba" status: 204 len: 0 microversion: 2.1 time: 0.109731 Apr 19 14:01:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 84/251] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:01:25 2023] DELETE /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:01:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-753b4e0e-1f84-4b7f-b305-322fd3098805 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:25 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-753b4e0e-1f84-4b7f-b305-322fd3098805 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: dee689b0-177a-4265-a296-c75cd57e74ba] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-753b4e0e-1f84-4b7f-b305-322fd3098805 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-753b4e0e-1f84-4b7f-b305-322fd3098805 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-753b4e0e-1f84-4b7f-b305-322fd3098805 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-753b4e0e-1f84-4b7f-b305-322fd3098805 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-753b4e0e-1f84-4b7f-b305-322fd3098805 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-753b4e0e-1f84-4b7f-b305-322fd3098805 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:26 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-753b4e0e-1f84-4b7f-b305-322fd3098805 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0088ff4bd64218b490c3414afb1c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b882fb2e40e74c88a69342ca2385b28f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:26 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-753b4e0e-1f84-4b7f-b305-322fd3098805 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba" status: 200 len: 1668 microversion: 2.1 time: 0.298727 Apr 19 14:01:26 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 83/252] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:25 2023] GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba => generated 1668 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:01:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-9b0700ce-8068-4644-985c-f3c8149d4616 req-c84c7504-473b-443f-93b0-c6045e50a35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547f7955-94c5-48e4-8705-456f5d4c2d99", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1b519-4623-46ca-90c7-9ed496dcae15"}, {"server_uuid": "dee689b0-177a-4265-a296-c75cd57e74ba", "name": "network-vif-unplugged", "status": "completed", "tag": "18f0605d-b40a-40a3-9eda-f2d5c5a95867"}, {"server_uuid": "dee689b0-177a-4265-a296-c75cd57e74ba", "name": "network-vif-plugged", "status": "completed", "tag": "18f0605d-b40a-40a3-9eda-f2d5c5a95867"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9b0700ce-8068-4644-985c-f3c8149d4616 req-c84c7504-473b-443f-93b0-c6045e50a35e service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9b0700ce-8068-4644-985c-f3c8149d4616 req-c84c7504-473b-443f-93b0-c6045e50a35e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-9b0700ce-8068-4644-985c-f3c8149d4616 req-c84c7504-473b-443f-93b0-c6045e50a35e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9b0700ce-8068-4644-985c-f3c8149d4616 req-c84c7504-473b-443f-93b0-c6045e50a35e service nova] Creating event network-vif-plugged:2eb1b519-4623-46ca-90c7-9ed496dcae15 for instance 547f7955-94c5-48e4-8705-456f5d4c2d99 on user Apr 19 14:01:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9b0700ce-8068-4644-985c-f3c8149d4616 req-c84c7504-473b-443f-93b0-c6045e50a35e service nova] Creating event network-vif-unplugged:18f0605d-b40a-40a3-9eda-f2d5c5a95867 for instance dee689b0-177a-4265-a296-c75cd57e74ba on user Apr 19 14:01:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-9b0700ce-8068-4644-985c-f3c8149d4616 req-c84c7504-473b-443f-93b0-c6045e50a35e service nova] Creating event network-vif-plugged:18f0605d-b40a-40a3-9eda-f2d5c5a95867 for instance dee689b0-177a-4265-a296-c75cd57e74ba on user Apr 19 14:01:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-9b0700ce-8068-4644-985c-f3c8149d4616 req-c84c7504-473b-443f-93b0-c6045e50a35e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.047775 Apr 19 14:01:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 86/253] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:26 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-b9a0583f-97a4-4ff6-8c90-401852302d67 req-850728ba-10b3-4808-8d47-7d801b4879ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee689b0-177a-4265-a296-c75cd57e74ba", "name": "network-vif-deleted", "tag": "18f0605d-b40a-40a3-9eda-f2d5c5a95867"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b9a0583f-97a4-4ff6-8c90-401852302d67 req-850728ba-10b3-4808-8d47-7d801b4879ed service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b9a0583f-97a4-4ff6-8c90-401852302d67 req-850728ba-10b3-4808-8d47-7d801b4879ed service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-b9a0583f-97a4-4ff6-8c90-401852302d67 req-850728ba-10b3-4808-8d47-7d801b4879ed service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-b9a0583f-97a4-4ff6-8c90-401852302d67 req-850728ba-10b3-4808-8d47-7d801b4879ed service nova] Creating event network-vif-deleted:18f0605d-b40a-40a3-9eda-f2d5c5a95867 for instance dee689b0-177a-4265-a296-c75cd57e74ba on user Apr 19 14:01:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-b9a0583f-97a4-4ff6-8c90-401852302d67 req-850728ba-10b3-4808-8d47-7d801b4879ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052917 Apr 19 14:01:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 85/254] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9110d192-ed68-4d53-9b9e-f7d947237f1b tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9110d192-ed68-4d53-9b9e-f7d947237f1b tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 39b00836-b75e-499d-be70-8a56500a3ebb] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9110d192-ed68-4d53-9b9e-f7d947237f1b tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9110d192-ed68-4d53-9b9e-f7d947237f1b tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9110d192-ed68-4d53-9b9e-f7d947237f1b tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9110d192-ed68-4d53-9b9e-f7d947237f1b tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9110d192-ed68-4d53-9b9e-f7d947237f1b tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9110d192-ed68-4d53-9b9e-f7d947237f1b tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:49 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-9110d192-ed68-4d53-9b9e-f7d947237f1b tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9110d192-ed68-4d53-9b9e-f7d947237f1b tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb" status: 200 len: 1535 microversion: 2.1 time: 0.365025 Apr 19 14:01:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 84/255] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:49 2023] GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb => generated 1535 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Searching by: {'deleted': False, 'project_id': '833c753ebd4a43f3a70e30069a91f159'} {{(pid=61611) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:49 user devstack@n-api.service[61611]: DEBUG nova.compute.multi_cell_list [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 19 14:01:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-39adc454-20c3-4f6d-9eb4-cd8f16bbf9c1 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.222097 Apr 19 14:01:49 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 87/256] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 19 14:01:49 2023] GET /compute/v2.1/servers => generated 340 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:49 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:49 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:01:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-1524737c-cb5e-4759-b5a8-a8ac45bc9122 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:49 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-1524737c-cb5e-4759-b5a8-a8ac45bc9122 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 39b00836-b75e-499d-be70-8a56500a3ebb] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1524737c-cb5e-4759-b5a8-a8ac45bc9122 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1524737c-cb5e-4759-b5a8-a8ac45bc9122 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1524737c-cb5e-4759-b5a8-a8ac45bc9122 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1524737c-cb5e-4759-b5a8-a8ac45bc9122 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1524737c-cb5e-4759-b5a8-a8ac45bc9122 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-1524737c-cb5e-4759-b5a8-a8ac45bc9122 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:50 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-1524737c-cb5e-4759-b5a8-a8ac45bc9122 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-1524737c-cb5e-4759-b5a8-a8ac45bc9122 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb" status: 200 len: 1535 microversion: 2.1 time: 0.220374 Apr 19 14:01:50 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 86/257] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:49 2023] GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb => generated 1535 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:01:51 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-fd56d0e3-2ee4-4aba-9494-04064ffa0407 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:51 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-fd56d0e3-2ee4-4aba-9494-04064ffa0407 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 39b00836-b75e-499d-be70-8a56500a3ebb] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd56d0e3-2ee4-4aba-9494-04064ffa0407 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd56d0e3-2ee4-4aba-9494-04064ffa0407 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd56d0e3-2ee4-4aba-9494-04064ffa0407 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd56d0e3-2ee4-4aba-9494-04064ffa0407 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd56d0e3-2ee4-4aba-9494-04064ffa0407 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:51 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd56d0e3-2ee4-4aba-9494-04064ffa0407 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:51 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-fd56d0e3-2ee4-4aba-9494-04064ffa0407 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 39b00836-b75e-499d-be70-8a56500a3ebb] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:01:51 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-fd56d0e3-2ee4-4aba-9494-04064ffa0407 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb" status: 204 len: 0 microversion: 2.1 time: 0.120815 Apr 19 14:01:51 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 85/258] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:01:51 2023] DELETE /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:01:51 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-1a3020dc-9946-409a-af47-98b21f3cd27f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:51 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-1a3020dc-9946-409a-af47-98b21f3cd27f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 39b00836-b75e-499d-be70-8a56500a3ebb] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1a3020dc-9946-409a-af47-98b21f3cd27f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1a3020dc-9946-409a-af47-98b21f3cd27f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1a3020dc-9946-409a-af47-98b21f3cd27f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1a3020dc-9946-409a-af47-98b21f3cd27f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1a3020dc-9946-409a-af47-98b21f3cd27f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1a3020dc-9946-409a-af47-98b21f3cd27f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:52 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-e714478b-4d84-46f6-96f0-c85dc226d24f req-5eaafe37-be9a-4d6b-bfd0-525dc03c295c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b00836-b75e-499d-be70-8a56500a3ebb", "name": "network-vif-unplugged", "status": "completed", "tag": "ecf78dd9-dbb7-4316-a53a-911bc91656bb"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e714478b-4d84-46f6-96f0-c85dc226d24f req-5eaafe37-be9a-4d6b-bfd0-525dc03c295c service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e714478b-4d84-46f6-96f0-c85dc226d24f req-5eaafe37-be9a-4d6b-bfd0-525dc03c295c service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e714478b-4d84-46f6-96f0-c85dc226d24f req-5eaafe37-be9a-4d6b-bfd0-525dc03c295c service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-e714478b-4d84-46f6-96f0-c85dc226d24f req-5eaafe37-be9a-4d6b-bfd0-525dc03c295c service nova] Creating event network-vif-unplugged:ecf78dd9-dbb7-4316-a53a-911bc91656bb for instance 39b00836-b75e-499d-be70-8a56500a3ebb on user Apr 19 14:01:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-e714478b-4d84-46f6-96f0-c85dc226d24f req-5eaafe37-be9a-4d6b-bfd0-525dc03c295c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162810 Apr 19 14:01:52 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 87/259] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:52 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-1a3020dc-9946-409a-af47-98b21f3cd27f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659c76db8ca8424a8c46a43936dfc7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833c753ebd4a43f3a70e30069a91f159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-1a3020dc-9946-409a-af47-98b21f3cd27f tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb" status: 200 len: 1541 microversion: 2.1 time: 0.428395 Apr 19 14:01:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 88/260] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:51 2023] GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb => generated 1541 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-4d549a31-9977-4f5c-b2ba-61ccb800ae64 req-02b228ca-1475-41de-9adc-f4f31eb215bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b00836-b75e-499d-be70-8a56500a3ebb", "name": "network-vif-deleted", "tag": "ecf78dd9-dbb7-4316-a53a-911bc91656bb"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4d549a31-9977-4f5c-b2ba-61ccb800ae64 req-02b228ca-1475-41de-9adc-f4f31eb215bb service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4d549a31-9977-4f5c-b2ba-61ccb800ae64 req-02b228ca-1475-41de-9adc-f4f31eb215bb service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4d549a31-9977-4f5c-b2ba-61ccb800ae64 req-02b228ca-1475-41de-9adc-f4f31eb215bb service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-4d549a31-9977-4f5c-b2ba-61ccb800ae64 req-02b228ca-1475-41de-9adc-f4f31eb215bb service nova] Creating event network-vif-deleted:ecf78dd9-dbb7-4316-a53a-911bc91656bb for instance 39b00836-b75e-499d-be70-8a56500a3ebb on user Apr 19 14:01:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-4d549a31-9977-4f5c-b2ba-61ccb800ae64 req-02b228ca-1475-41de-9adc-f4f31eb215bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092473 Apr 19 14:01:53 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 86/261] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: 478b7934-6a66-4630-b756-521846ab8230] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:53 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] HTTP exception thrown: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Request method failure captured: Apr 19 14:01:53 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230 HTTP/1.1 Apr 19 14:01:53 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:01:53 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:01:53 user devstack@n-api.service[61613]: Connection: close Apr 19 14:01:53 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:01:53 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:01:53 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:01:53 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:01:53 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_M-dOEQ-4NBT4IixUWMW4Q_XRKqMM1rQypK-oJsBSGH_M8decPNRw1YBaLt4cA8hzjFi4aNWA1mhw2-7Z2rDyVY1sf25VgCwFUxteYsW3trJwQMPTJ0NH1k1V6laIhblLnZ9wF3iIRLgwGQ2pouoQxVqo2XyZSFWjW3Cn8ig0RBy-s Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Project-Id: 806255a694c7446893131ff6de13c42d Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/806255a694c7446893131ff6de13c42d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/806255a694c7446893131ff6de13c42d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/806255a694c7446893131ff6de13c42d"}]}] Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Tenant: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Tenant-Id: 806255a694c7446893131ff6de13c42d Apr 19 14:01:53 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:01:53 user devstack@n-api.service[61613]: X-User: tempest-ServersNegativeTestJSON-1629002614-project-member Apr 19 14:01:53 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:01:53 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:01:53 user devstack@n-api.service[61613]: X-User-Id: 9bb00927681348c08cabf5cea1edaac2 Apr 19 14:01:53 user devstack@n-api.service[61613]: X-User-Name: tempest-ServersNegativeTestJSON-1629002614-project-member Apr 19 14:01:53 user devstack@n-api.service[61613]: method: > Apr 19 14:01:53 user devstack@n-api.service[61613]: exception: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:01:53 user devstack@n-api.service[61613]: action_args: {'id': '478b7934-6a66-4630-b756-521846ab8230'} Apr 19 14:01:53 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:01:53 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Returning 404 to user: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:01:53 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-ca3ea1d8-c749-4f52-bad0-80a034760661 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230" status: 404 len: 111 microversion: 2.1 time: 0.030931 Apr 19 14:01:53 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 88/262] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:53 2023] GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:01:53 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ec09ce75-b138-4a2a-b211-59a765b7467e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:53 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ec09ce75-b138-4a2a-b211-59a765b7467e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec09ce75-b138-4a2a-b211-59a765b7467e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec09ce75-b138-4a2a-b211-59a765b7467e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec09ce75-b138-4a2a-b211-59a765b7467e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec09ce75-b138-4a2a-b211-59a765b7467e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec09ce75-b138-4a2a-b211-59a765b7467e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:53 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ec09ce75-b138-4a2a-b211-59a765b7467e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:53 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-ec09ce75-b138-4a2a-b211-59a765b7467e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb00927681348c08cabf5cea1edaac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806255a694c7446893131ff6de13c42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:53 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ec09ce75-b138-4a2a-b211-59a765b7467e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452" status: 200 len: 1493 microversion: 2.1 time: 0.237849 Apr 19 14:01:53 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 89/263] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:53 2023] GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452 => generated 1493 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c0c17daf-a652-48c8-bd96-c3de7a29efd1 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c0c17daf-a652-48c8-bd96-c3de7a29efd1 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: f17f6de2-942d-44ab-9d65-ccc1abe92dbb] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c17daf-a652-48c8-bd96-c3de7a29efd1 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c17daf-a652-48c8-bd96-c3de7a29efd1 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c17daf-a652-48c8-bd96-c3de7a29efd1 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c17daf-a652-48c8-bd96-c3de7a29efd1 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c17daf-a652-48c8-bd96-c3de7a29efd1 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c0c17daf-a652-48c8-bd96-c3de7a29efd1 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:53 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-c0c17daf-a652-48c8-bd96-c3de7a29efd1 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lazy-loading 'flavor' on Instance uuid f17f6de2-942d-44ab-9d65-ccc1abe92dbb {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 14:01:53 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c0c17daf-a652-48c8-bd96-c3de7a29efd1 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb/action" status: 200 len: 32 microversion: 2.1 time: 0.141723 Apr 19 14:01:53 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 87/264] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 19 14:01:53 2023] POST /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d192141c-3342-4907-847e-ff843ced1e35 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d192141c-3342-4907-847e-ff843ced1e35 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: f17f6de2-942d-44ab-9d65-ccc1abe92dbb] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d192141c-3342-4907-847e-ff843ced1e35 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d192141c-3342-4907-847e-ff843ced1e35 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d192141c-3342-4907-847e-ff843ced1e35 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d192141c-3342-4907-847e-ff843ced1e35 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d192141c-3342-4907-847e-ff843ced1e35 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:53 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d192141c-3342-4907-847e-ff843ced1e35 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:54 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d192141c-3342-4907-847e-ff843ced1e35 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b82a409207a14dbd96308936b12a65fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d563f8793494ae697180a5f58c11758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:01:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d192141c-3342-4907-847e-ff843ced1e35 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb" status: 200 len: 1510 microversion: 2.1 time: 0.271736 Apr 19 14:01:54 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:01:53 2023] GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:01:54 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-def84ce3-0492-4d1d-8cdd-994b73f1341c req-b03b79c6-d535-4fe9-8450-38e8e090d740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b00836-b75e-499d-be70-8a56500a3ebb", "name": "network-vif-plugged", "status": "completed", "tag": "ecf78dd9-dbb7-4316-a53a-911bc91656bb"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-def84ce3-0492-4d1d-8cdd-994b73f1341c req-b03b79c6-d535-4fe9-8450-38e8e090d740 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-def84ce3-0492-4d1d-8cdd-994b73f1341c req-b03b79c6-d535-4fe9-8450-38e8e090d740 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:54 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-def84ce3-0492-4d1d-8cdd-994b73f1341c req-b03b79c6-d535-4fe9-8450-38e8e090d740 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:54 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-def84ce3-0492-4d1d-8cdd-994b73f1341c req-b03b79c6-d535-4fe9-8450-38e8e090d740 service nova] Creating event network-vif-plugged:ecf78dd9-dbb7-4316-a53a-911bc91656bb for instance 39b00836-b75e-499d-be70-8a56500a3ebb on user Apr 19 14:01:54 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-def84ce3-0492-4d1d-8cdd-994b73f1341c req-b03b79c6-d535-4fe9-8450-38e8e090d740 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027315 Apr 19 14:01:54 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 90/266] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-79f94d41-d359-418c-9f8d-17055099a1ce req-241b1843-ee99-4465-9aa6-ed1e64a25e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17f6de2-942d-44ab-9d65-ccc1abe92dbb", "name": "network-vif-unplugged", "status": "completed", "tag": "dd36104d-1964-49d9-8371-84bd895cc49c"}, {"server_uuid": "f17f6de2-942d-44ab-9d65-ccc1abe92dbb", "name": "network-vif-plugged", "status": "completed", "tag": "dd36104d-1964-49d9-8371-84bd895cc49c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-79f94d41-d359-418c-9f8d-17055099a1ce req-241b1843-ee99-4465-9aa6-ed1e64a25e4b service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-79f94d41-d359-418c-9f8d-17055099a1ce req-241b1843-ee99-4465-9aa6-ed1e64a25e4b service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:56 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-79f94d41-d359-418c-9f8d-17055099a1ce req-241b1843-ee99-4465-9aa6-ed1e64a25e4b service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-79f94d41-d359-418c-9f8d-17055099a1ce req-241b1843-ee99-4465-9aa6-ed1e64a25e4b service nova] Creating event network-vif-unplugged:dd36104d-1964-49d9-8371-84bd895cc49c for instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb on user Apr 19 14:01:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-79f94d41-d359-418c-9f8d-17055099a1ce req-241b1843-ee99-4465-9aa6-ed1e64a25e4b service nova] Creating event network-vif-plugged:dd36104d-1964-49d9-8371-84bd895cc49c for instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb on user Apr 19 14:01:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-79f94d41-d359-418c-9f8d-17055099a1ce req-241b1843-ee99-4465-9aa6-ed1e64a25e4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.070128 Apr 19 14:01:56 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 88/267] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:56 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:01:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-e494dd48-fabe-4999-957e-c6b061fa6549 req-82fdd82e-4d2e-481b-beaf-f719c7991e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17f6de2-942d-44ab-9d65-ccc1abe92dbb", "name": "network-vif-plugged", "status": "completed", "tag": "dd36104d-1964-49d9-8371-84bd895cc49c"}, {"server_uuid": "f17f6de2-942d-44ab-9d65-ccc1abe92dbb", "name": "network-vif-plugged", "status": "completed", "tag": "dd36104d-1964-49d9-8371-84bd895cc49c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:01:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e494dd48-fabe-4999-957e-c6b061fa6549 req-82fdd82e-4d2e-481b-beaf-f719c7991e0d service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:01:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e494dd48-fabe-4999-957e-c6b061fa6549 req-82fdd82e-4d2e-481b-beaf-f719c7991e0d service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:01:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e494dd48-fabe-4999-957e-c6b061fa6549 req-82fdd82e-4d2e-481b-beaf-f719c7991e0d service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:01:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-e494dd48-fabe-4999-957e-c6b061fa6549 req-82fdd82e-4d2e-481b-beaf-f719c7991e0d service nova] Creating event network-vif-plugged:dd36104d-1964-49d9-8371-84bd895cc49c for instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb on user Apr 19 14:01:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-e494dd48-fabe-4999-957e-c6b061fa6549 req-82fdd82e-4d2e-481b-beaf-f719c7991e0d service nova] Creating event network-vif-plugged:dd36104d-1964-49d9-8371-84bd895cc49c for instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb on user Apr 19 14:01:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-e494dd48-fabe-4999-957e-c6b061fa6549 req-82fdd82e-4d2e-481b-beaf-f719c7991e0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029661 Apr 19 14:01:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 90/268] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:01:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:02 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-17402da8-5b77-497c-81fd-38346af4342e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:03 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-17402da8-5b77-497c-81fd-38346af4342e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-17402da8-5b77-497c-81fd-38346af4342e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-17402da8-5b77-497c-81fd-38346af4342e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-17402da8-5b77-497c-81fd-38346af4342e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-17402da8-5b77-497c-81fd-38346af4342e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-17402da8-5b77-497c-81fd-38346af4342e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-17402da8-5b77-497c-81fd-38346af4342e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-17402da8-5b77-497c-81fd-38346af4342e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.165337 Apr 19 14:02:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 91/269] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:02:02 2023] GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0/os-interface => generated 283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:04 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-27189cd1-31c3-4707-8ac3-4161de14b7be req-25d90bf5-8cbf-45a4-8107-411202a175a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f5347a-291b-4d70-a8d9-58ca074f2ed0", "tag": "564734f2-3021-409d-bb40-2cc561379e24"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-27189cd1-31c3-4707-8ac3-4161de14b7be req-25d90bf5-8cbf-45a4-8107-411202a175a4 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-27189cd1-31c3-4707-8ac3-4161de14b7be req-25d90bf5-8cbf-45a4-8107-411202a175a4 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:04 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-27189cd1-31c3-4707-8ac3-4161de14b7be req-25d90bf5-8cbf-45a4-8107-411202a175a4 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-27189cd1-31c3-4707-8ac3-4161de14b7be req-25d90bf5-8cbf-45a4-8107-411202a175a4 service nova] Creating event network-changed:564734f2-3021-409d-bb40-2cc561379e24 for instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 on user Apr 19 14:02:04 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-27189cd1-31c3-4707-8ac3-4161de14b7be req-25d90bf5-8cbf-45a4-8107-411202a175a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041544 Apr 19 14:02:04 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 89/270] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:02:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:04 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f2b8bf49-64e5-4008-a444-7f6858753fb6 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:04 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f2b8bf49-64e5-4008-a444-7f6858753fb6 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf49-64e5-4008-a444-7f6858753fb6 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf49-64e5-4008-a444-7f6858753fb6 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf49-64e5-4008-a444-7f6858753fb6 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf49-64e5-4008-a444-7f6858753fb6 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf49-64e5-4008-a444-7f6858753fb6 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:04 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf49-64e5-4008-a444-7f6858753fb6 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:04 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-f2b8bf49-64e5-4008-a444-7f6858753fb6 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0/ips" status: 200 len: 108 microversion: 2.1 time: 0.042647 Apr 19 14:02:04 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:02:04 2023] GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0/ips => generated 108 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:05 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-83acf018-cd76-4e1a-9f54-3ea9f37a982c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:05 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-83acf018-cd76-4e1a-9f54-3ea9f37a982c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] HTTP exception thrown: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Request method failure captured: Apr 19 14:02:05 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb HTTP/1.1 Apr 19 14:02:05 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:02:05 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:02:05 user devstack@n-api.service[61611]: Connection: close Apr 19 14:02:05 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:02:05 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:02:05 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:02:05 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:02:05 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_MDiDeU3z5Oj0o7maoG-JahmsnDswZzSHArZroi7Im2Zlvgb-UjHSDNsJ4POX2kmEUEQupTojjrXkZn7svHgef6jH6zEGBlp7kEtcgg4ZDLJ353e-PJu3xQ6T3z4NgEqzmTFW779KaZCoAeFrPGIPz1pP69Acr761N7F3Z3fqAkdsQ Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Project-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d2b244a7fcf46baab5d636ba6e58fb7"}]}] Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Tenant-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 14:02:05 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:05 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 14:02:05 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:02:05 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:02:05 user devstack@n-api.service[61611]: X-User-Id: 825cd7cdbfad406197e3230a687dcfcc Apr 19 14:02:05 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 14:02:05 user devstack@n-api.service[61611]: method: > Apr 19 14:02:05 user devstack@n-api.service[61611]: exception: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:05 user devstack@n-api.service[61611]: action_args: {'id': 'f9269f8b-60eb-4cd7-a58d-c34df1d32deb'} Apr 19 14:02:05 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:05 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Returning 404 to user: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:02:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-39b46eff-5d08-4c58-8fe3-ae28b57c27d0 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb" status: 404 len: 111 microversion: 2.20 time: 0.138967 Apr 19 14:02:05 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 92/272] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:02:05 2023] GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:02:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-83acf018-cd76-4e1a-9f54-3ea9f37a982c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-83acf018-cd76-4e1a-9f54-3ea9f37a982c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-83acf018-cd76-4e1a-9f54-3ea9f37a982c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-94e14cb3-dc7c-4de9-94ed-c09261634413 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '.version_select at 0x7f60de695000>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-83acf018-cd76-4e1a-9f54-3ea9f37a982c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-83acf018-cd76-4e1a-9f54-3ea9f37a982c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:05 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-83acf018-cd76-4e1a-9f54-3ea9f37a982c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-94e14cb3-dc7c-4de9-94ed-c09261634413 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-824893131" status: 204 len: 0 microversion: 2.20 time: 0.036821 Apr 19 14:02:05 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 92/273] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 19 14:02:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-824893131 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 14:02:05 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-83acf018-cd76-4e1a-9f54-3ea9f37a982c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:02:05 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-83acf018-cd76-4e1a-9f54-3ea9f37a982c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0" status: 204 len: 0 microversion: 2.1 time: 0.163502 Apr 19 14:02:05 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 90/274] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:02:05 2023] DELETE /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7dd0dec1-b105-49d1-9230-55fbfcdc51b3 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-7dd0dec1-b105-49d1-9230-55fbfcdc51b3 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7dd0dec1-b105-49d1-9230-55fbfcdc51b3 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7dd0dec1-b105-49d1-9230-55fbfcdc51b3 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7dd0dec1-b105-49d1-9230-55fbfcdc51b3 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7dd0dec1-b105-49d1-9230-55fbfcdc51b3 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7dd0dec1-b105-49d1-9230-55fbfcdc51b3 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7dd0dec1-b105-49d1-9230-55fbfcdc51b3 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:05 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7dd0dec1-b105-49d1-9230-55fbfcdc51b3 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390686e4c10c40f0b1df9b2ba9557484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606afa926de4400819fac2cce6813a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:02:05 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7dd0dec1-b105-49d1-9230-55fbfcdc51b3 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0" status: 200 len: 1668 microversion: 2.1 time: 0.201999 Apr 19 14:02:05 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 93/275] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:02:05 2023] GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0 => generated 1668 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:02:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-d530a8a7-4850-4de5-8b83-428dc40e3c02 req-86682fe6-fd62-4421-99cb-84149ceffe96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f5347a-291b-4d70-a8d9-58ca074f2ed0", "name": "network-vif-unplugged", "status": "completed", "tag": "564734f2-3021-409d-bb40-2cc561379e24"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d530a8a7-4850-4de5-8b83-428dc40e3c02 req-86682fe6-fd62-4421-99cb-84149ceffe96 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d530a8a7-4850-4de5-8b83-428dc40e3c02 req-86682fe6-fd62-4421-99cb-84149ceffe96 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d530a8a7-4850-4de5-8b83-428dc40e3c02 req-86682fe6-fd62-4421-99cb-84149ceffe96 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-d530a8a7-4850-4de5-8b83-428dc40e3c02 req-86682fe6-fd62-4421-99cb-84149ceffe96 service nova] Creating event network-vif-unplugged:564734f2-3021-409d-bb40-2cc561379e24 for instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 on user Apr 19 14:02:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-d530a8a7-4850-4de5-8b83-428dc40e3c02 req-86682fe6-fd62-4421-99cb-84149ceffe96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035259 Apr 19 14:02:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 93/276] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:02:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 14:02:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:06 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:06 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] HTTP exception thrown: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Request method failure captured: Apr 19 14:02:06 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb HTTP/1.1 Apr 19 14:02:06 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:02:06 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:02:06 user devstack@n-api.service[61612]: Connection: close Apr 19 14:02:06 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:02:06 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:02:06 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:02:06 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:02:06 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_MDiDeU3z5Oj0o7maoG-JahmsnDswZzSHArZroi7Im2Zlvgb-UjHSDNsJ4POX2kmEUEQupTojjrXkZn7svHgef6jH6zEGBlp7kEtcgg4ZDLJ353e-PJu3xQ6T3z4NgEqzmTFW779KaZCoAeFrPGIPz1pP69Acr761N7F3Z3fqAkdsQ Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Project-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d2b244a7fcf46baab5d636ba6e58fb7"}]}] Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Tenant-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 14:02:06 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:06 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 14:02:06 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:02:06 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:02:06 user devstack@n-api.service[61612]: X-User-Id: 825cd7cdbfad406197e3230a687dcfcc Apr 19 14:02:06 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 14:02:06 user devstack@n-api.service[61612]: method: > Apr 19 14:02:06 user devstack@n-api.service[61612]: exception: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:06 user devstack@n-api.service[61612]: action_args: {'id': 'f9269f8b-60eb-4cd7-a58d-c34df1d32deb'} Apr 19 14:02:06 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:06 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:06 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Returning 404 to user: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:02:06 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6d362968-4426-47a1-a9b4-52580e01fce8 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb" status: 404 len: 111 microversion: 2.20 time: 0.029945 Apr 19 14:02:06 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 91/277] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:02:06 2023] DELETE /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:02:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:06 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: f9269f8b-60eb-4cd7-a58d-c34df1d32deb] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:06 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] HTTP exception thrown: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Request method failure captured: Apr 19 14:02:06 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb HTTP/1.1 Apr 19 14:02:06 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:02:06 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:02:06 user devstack@n-api.service[61611]: Connection: close Apr 19 14:02:06 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:02:06 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:02:06 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:02:06 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:02:06 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_MDiDeU3z5Oj0o7maoG-JahmsnDswZzSHArZroi7Im2Zlvgb-UjHSDNsJ4POX2kmEUEQupTojjrXkZn7svHgef6jH6zEGBlp7kEtcgg4ZDLJ353e-PJu3xQ6T3z4NgEqzmTFW779KaZCoAeFrPGIPz1pP69Acr761N7F3Z3fqAkdsQ Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Project-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d2b244a7fcf46baab5d636ba6e58fb7"}]}] Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Tenant-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 14:02:06 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:06 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 14:02:06 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:02:06 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:02:06 user devstack@n-api.service[61611]: X-User-Id: 825cd7cdbfad406197e3230a687dcfcc Apr 19 14:02:06 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 14:02:06 user devstack@n-api.service[61611]: method: > Apr 19 14:02:06 user devstack@n-api.service[61611]: exception: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:06 user devstack@n-api.service[61611]: action_args: {'id': 'f9269f8b-60eb-4cd7-a58d-c34df1d32deb'} Apr 19 14:02:06 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. Apr 19 14:02:06 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:06 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Returning 404 to user: Instance f9269f8b-60eb-4cd7-a58d-c34df1d32deb could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:02:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c86a6320-128b-44be-af57-de6d5bfd9a01 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb" status: 404 len: 111 microversion: 2.20 time: 0.026234 Apr 19 14:02:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 94/278] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:02:06 2023] GET /compute/v2.1/servers/f9269f8b-60eb-4cd7-a58d-c34df1d32deb => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:02:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:07 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] HTTP exception thrown: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 14:02:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Request method failure captured: Apr 19 14:02:07 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b HTTP/1.1 Apr 19 14:02:07 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:02:07 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:02:07 user devstack@n-api.service[61613]: Connection: close Apr 19 14:02:07 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:02:07 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:02:07 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:02:07 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:02:07 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_MDiDeU3z5Oj0o7maoG-JahmsnDswZzSHArZroi7Im2Zlvgb-UjHSDNsJ4POX2kmEUEQupTojjrXkZn7svHgef6jH6zEGBlp7kEtcgg4ZDLJ353e-PJu3xQ6T3z4NgEqzmTFW779KaZCoAeFrPGIPz1pP69Acr761N7F3Z3fqAkdsQ Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Project-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d2b244a7fcf46baab5d636ba6e58fb7"}]}] Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Tenant-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 14:02:07 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:07 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 14:02:07 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:02:07 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:02:07 user devstack@n-api.service[61613]: X-User-Id: 825cd7cdbfad406197e3230a687dcfcc Apr 19 14:02:07 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 14:02:07 user devstack@n-api.service[61613]: method: > Apr 19 14:02:07 user devstack@n-api.service[61613]: exception: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 14:02:07 user devstack@n-api.service[61613]: action_args: {'id': '20c95eb6-9d18-41fa-b334-0c423a01241b'} Apr 19 14:02:07 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 14:02:07 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Returning 404 to user: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:02:07 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-5396f3d0-60a2-4439-9133-b43e71ccaa92 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b" status: 404 len: 111 microversion: 2.20 time: 0.044447 Apr 19 14:02:07 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 94/279] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:02:07 2023] DELETE /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:02:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:07 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] [instance: 20c95eb6-9d18-41fa-b334-0c423a01241b] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] HTTP exception thrown: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 14:02:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Request method failure captured: Apr 19 14:02:07 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b HTTP/1.1 Apr 19 14:02:07 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:02:07 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:02:07 user devstack@n-api.service[61612]: Connection: close Apr 19 14:02:07 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:02:07 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:02:07 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:02:07 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:02:07 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_MDiDeU3z5Oj0o7maoG-JahmsnDswZzSHArZroi7Im2Zlvgb-UjHSDNsJ4POX2kmEUEQupTojjrXkZn7svHgef6jH6zEGBlp7kEtcgg4ZDLJ353e-PJu3xQ6T3z4NgEqzmTFW779KaZCoAeFrPGIPz1pP69Acr761N7F3Z3fqAkdsQ Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Project-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d2b244a7fcf46baab5d636ba6e58fb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d2b244a7fcf46baab5d636ba6e58fb7"}]}] Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Tenant-Id: 8d2b244a7fcf46baab5d636ba6e58fb7 Apr 19 14:02:07 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1349701874 Apr 19 14:02:07 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 14:02:07 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:02:07 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:02:07 user devstack@n-api.service[61612]: X-User-Id: 825cd7cdbfad406197e3230a687dcfcc Apr 19 14:02:07 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1349701874-project-member Apr 19 14:02:07 user devstack@n-api.service[61612]: method: > Apr 19 14:02:07 user devstack@n-api.service[61612]: exception: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 14:02:07 user devstack@n-api.service[61612]: action_args: {'id': '20c95eb6-9d18-41fa-b334-0c423a01241b'} Apr 19 14:02:07 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. Apr 19 14:02:07 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] Returning 404 to user: Instance 20c95eb6-9d18-41fa-b334-0c423a01241b could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:02:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9ff5aa5f-2ac9-4306-8ccd-58b7b78d3156 tempest-AttachVolumeShelveTestJSON-1349701874 tempest-AttachVolumeShelveTestJSON-1349701874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b" status: 404 len: 111 microversion: 2.20 time: 0.028457 Apr 19 14:02:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 92/280] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:02:07 2023] GET /compute/v2.1/servers/20c95eb6-9d18-41fa-b334-0c423a01241b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:02:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-28c2472a-a4a1-46d3-989b-605dcd38acae req-148ad167-3371-470c-acd7-5404f7c4aa16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f5347a-291b-4d70-a8d9-58ca074f2ed0", "name": "network-vif-deleted", "tag": "564734f2-3021-409d-bb40-2cc561379e24"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-28c2472a-a4a1-46d3-989b-605dcd38acae req-148ad167-3371-470c-acd7-5404f7c4aa16 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-28c2472a-a4a1-46d3-989b-605dcd38acae req-148ad167-3371-470c-acd7-5404f7c4aa16 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-28c2472a-a4a1-46d3-989b-605dcd38acae req-148ad167-3371-470c-acd7-5404f7c4aa16 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-28c2472a-a4a1-46d3-989b-605dcd38acae req-148ad167-3371-470c-acd7-5404f7c4aa16 service nova] Creating event network-vif-deleted:564734f2-3021-409d-bb40-2cc561379e24 for instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 on user Apr 19 14:02:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-28c2472a-a4a1-46d3-989b-605dcd38acae req-148ad167-3371-470c-acd7-5404f7c4aa16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027526 Apr 19 14:02:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 95/281] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:02:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-99ea0fe0-af0b-42c0-838d-e556794eca57 req-fdf198ab-384c-4017-af83-e546e6bd5141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f5347a-291b-4d70-a8d9-58ca074f2ed0", "name": "network-vif-plugged", "status": "completed", "tag": "564734f2-3021-409d-bb40-2cc561379e24"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-99ea0fe0-af0b-42c0-838d-e556794eca57 req-fdf198ab-384c-4017-af83-e546e6bd5141 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-99ea0fe0-af0b-42c0-838d-e556794eca57 req-fdf198ab-384c-4017-af83-e546e6bd5141 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-99ea0fe0-af0b-42c0-838d-e556794eca57 req-fdf198ab-384c-4017-af83-e546e6bd5141 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-99ea0fe0-af0b-42c0-838d-e556794eca57 req-fdf198ab-384c-4017-af83-e546e6bd5141 service nova] Creating event network-vif-plugged:564734f2-3021-409d-bb40-2cc561379e24 for instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 on user Apr 19 14:02:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-99ea0fe0-af0b-42c0-838d-e556794eca57 req-fdf198ab-384c-4017-af83-e546e6bd5141 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031495 Apr 19 14:02:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 95/282] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:02:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 547f7955-94c5-48e4-8705-456f5d4c2d99] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:02:09 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:02:09 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-96d984ff-172e-42ac-ba29-e60add572345 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99" status: 200 len: 1690 microversion: 2.87 time: 0.256877 Apr 19 14:02:09 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 93/283] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:02:09 2023] GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99 => generated 1690 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:02:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-678ef5ef-3970-435a-b51e-fcb16d7fb525 tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] Action: 'create', calling method: .version_select at 0x7f60de37b880>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-370228229"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-678ef5ef-3970-435a-b51e-fcb16d7fb525 tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.379915 Apr 19 14:02:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 96/284] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 19 14:02:11 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 384 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 19 14:02:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-20e98171-feb4-4b44-87fe-42f510f36365 tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] Calling method '.version_select at 0x7f60de468790>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-20e98171-feb4-4b44-87fe-42f510f36365 tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a" status: 200 len: 341 microversion: 2.1 time: 0.077107 Apr 19 14:02:11 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 14:02:11 2023] GET /compute/v2.1/os-volumes/e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a => generated 341 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:12 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-487e324f-3e8e-4d12-a083-55c362194916 tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] Calling method '.version_select at 0x7f60de4d9360>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-487e324f-3e8e-4d12-a083-55c362194916 tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a" status: 200 len: 341 microversion: 2.1 time: 0.069756 Apr 19 14:02:12 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 94/286] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 14:02:12 2023] GET /compute/v2.1/os-volumes/e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a => generated 341 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:12 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4a7c9096-68e5-468e-8505-45e6583b20f4 tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] Calling method '.version_select at 0x7f60de3bf010>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:12 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4a7c9096-68e5-468e-8505-45e6583b20f4 tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a" status: 202 len: 0 microversion: 2.1 time: 0.117456 Apr 19 14:02:12 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 97/287] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:02:12 2023] DELETE /compute/v2.1/os-volumes/e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:02:12 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bb48811e-07e2-4231-aa57-5989f8b5142d tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] Calling method '.version_select at 0x7f60de332ef0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-bb48811e-07e2-4231-aa57-5989f8b5142d tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] HTTP exception thrown: Volume e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a could not be found. Apr 19 14:02:12 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bb48811e-07e2-4231-aa57-5989f8b5142d tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] Request method failure captured: Apr 19 14:02:12 user devstack@n-api.service[61613]: request: GET /compute/v2.1/os-volumes/e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a HTTP/1.1 Apr 19 14:02:12 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:02:12 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:02:12 user devstack@n-api.service[61613]: Connection: close Apr 19 14:02:12 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:02:12 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:02:12 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:02:12 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:02:12 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_RjIl1EdfZAqb4Uirwjzd6Jg_iH3NAHaJGHKVGR9XynuI4ci7r01C_8rqgBp-fvz2mo7hOyOLEaQwf7lz6Tjs3KyrW9EVuYxuTL9t-w_mIwCxVC_Fr5cmU6FU_qR6PN5QQeqhParvk5UlWWt1LixbNmRqUy3rdzeFJ8knzikfwGbHc Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Project-Id: b1835a5255994c17a3e56d4b3f60a28f Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1952801511 Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b1835a5255994c17a3e56d4b3f60a28f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b1835a5255994c17a3e56d4b3f60a28f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b1835a5255994c17a3e56d4b3f60a28f"}]}] Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1952801511 Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Tenant-Id: b1835a5255994c17a3e56d4b3f60a28f Apr 19 14:02:12 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1952801511 Apr 19 14:02:12 user devstack@n-api.service[61613]: X-User: tempest-VolumesSnapshotsTestJSON-1952801511-project-member Apr 19 14:02:12 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:02:12 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:02:12 user devstack@n-api.service[61613]: X-User-Id: a919f4a722ef4ebe8d8271568d5b5353 Apr 19 14:02:12 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1952801511-project-member Apr 19 14:02:12 user devstack@n-api.service[61613]: method: Apr 19 14:02:12 user devstack@n-api.service[61613]: exception: Volume e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a could not be found. Apr 19 14:02:12 user devstack@n-api.service[61613]: action_args: {'id': 'e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a'} Apr 19 14:02:12 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a could not be found. (HTTP 404) (Request-ID: req-56aa6d00-0368-49d2-8d88-0a217aef9861) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a could not be found. Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a could not be found. Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a could not be found. Apr 19 14:02:12 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:12 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-bb48811e-07e2-4231-aa57-5989f8b5142d tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] Returning 404 to user: Volume e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:02:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-bb48811e-07e2-4231-aa57-5989f8b5142d tempest-VolumesSnapshotsTestJSON-1952801511 tempest-VolumesSnapshotsTestJSON-1952801511-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a" status: 404 len: 109 microversion: 2.1 time: 0.035255 Apr 19 14:02:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 97/288] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 14:02:12 2023] GET /compute/v2.1/os-volumes/e0b3b66b-ac3a-4f7a-a1b9-c71a87211f0a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:02:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:16 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] [instance: dee689b0-177a-4265-a296-c75cd57e74ba] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:16 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] HTTP exception thrown: Instance dee689b0-177a-4265-a296-c75cd57e74ba could not be found. Apr 19 14:02:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Request method failure captured: Apr 19 14:02:16 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba HTTP/1.1 Apr 19 14:02:16 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:02:16 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:02:16 user devstack@n-api.service[61612]: Connection: close Apr 19 14:02:16 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:02:16 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:02:16 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:02:16 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:02:16 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_L-R6bBayCMCix6c0HJh4JP8dlvNvMuvFj3jX0KbveQfwl_XJ63eUktYLThf9EhjsaqoF5Eh9NfBPL9uVV8LZXeYdzYnCuj7uKzt1MQUK5r2IBYudPVyXJ-6Ta-RKXWMfPcEuXF5AmnjagCcz3JWQissu4S8sJvcQE_8afVv7mq2dQ Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Project-Id: b882fb2e40e74c88a69342ca2385b28f Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesAdminNegativeTest-1313568547 Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b882fb2e40e74c88a69342ca2385b28f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b882fb2e40e74c88a69342ca2385b28f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b882fb2e40e74c88a69342ca2385b28f"}]}] Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesAdminNegativeTest-1313568547 Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Tenant-Id: b882fb2e40e74c88a69342ca2385b28f Apr 19 14:02:16 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1313568547 Apr 19 14:02:16 user devstack@n-api.service[61612]: X-User: tempest-VolumesAdminNegativeTest-1313568547-project-member Apr 19 14:02:16 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:02:16 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:02:16 user devstack@n-api.service[61612]: X-User-Id: ee0088ff4bd64218b490c3414afb1c76 Apr 19 14:02:16 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesAdminNegativeTest-1313568547-project-member Apr 19 14:02:16 user devstack@n-api.service[61612]: method: > Apr 19 14:02:16 user devstack@n-api.service[61612]: exception: Instance dee689b0-177a-4265-a296-c75cd57e74ba could not be found. Apr 19 14:02:16 user devstack@n-api.service[61612]: action_args: {'id': 'dee689b0-177a-4265-a296-c75cd57e74ba'} Apr 19 14:02:16 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dee689b0-177a-4265-a296-c75cd57e74ba could not be found. Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dee689b0-177a-4265-a296-c75cd57e74ba could not be found. Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dee689b0-177a-4265-a296-c75cd57e74ba could not be found. Apr 19 14:02:16 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:02:16 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Returning 404 to user: Instance dee689b0-177a-4265-a296-c75cd57e74ba could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:02:16 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-2968e0df-5eeb-4aeb-b060-09fde90461b1 tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba" status: 404 len: 111 microversion: 2.1 time: 0.181077 Apr 19 14:02:16 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 95/289] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:02:16 2023] GET /compute/v2.1/servers/dee689b0-177a-4265-a296-c75cd57e74ba => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:02:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-60aaa7d1-a37b-462b-b4af-f5842079c18c tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] Calling method '.version_select at 0x7f60de37ba30>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-60aaa7d1-a37b-462b-b4af-f5842079c18c tempest-VolumesAdminNegativeTest-1313568547 tempest-VolumesAdminNegativeTest-1313568547-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-123040742" status: 202 len: 0 microversion: 2.1 time: 0.022893 Apr 19 14:02:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 98/290] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:02:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-123040742 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:02:32 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:32 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=28 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:32 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-4939913e-42d7-4500-b998-96985b5562c9 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Action: 'create', calling method: .version_select at 0x7f60de378160>, body: {"keypair": {"name": "tempest-keypair-803253154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN1uStNQWjuUJyVQgFtI5hsFuAQc/WjN2yhXU6p2XGH2m2C7/O6NFL1M8KnkwDMEmG5tWCCAlcSkdi3c2b1pZ7gAsUaBQWxxtQ0PIyXh4UdXwTZbcjtrudS3qQ8vjwVUA=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:32 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-4939913e-42d7-4500-b998-96985b5562c9 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Getting quotas for project 30547cb5530e48a0bbcadde54e832d24. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:02:32 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-4939913e-42d7-4500-b998-96985b5562c9 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Getting quotas for user 9b32d5735f2a4babb219b9e66d5cd4ed and project 30547cb5530e48a0bbcadde54e832d24. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:02:32 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-4939913e-42d7-4500-b998-96985b5562c9 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.229796 Apr 19 14:02:32 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 98/291] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:02:32 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:33 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2131342124", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8d7c8fbe-dc96-4e30-92c9-171fb37c820a"}], "security_groups": [{"name": "tempest-securitygroup--302001453"}], "key_name": "tempest-keypair-803253154", "user_data": "}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:33 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:33 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:33 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] validate_networks() for [('8d7c8fbe-dc96-4e30-92c9-171fb37c820a', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Getting quotas for project 30547cb5530e48a0bbcadde54e832d24. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Getting quotas for user 9b32d5735f2a4babb219b9e66d5cd4ed and project 30547cb5530e48a0bbcadde54e832d24. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:02:34 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:02:34 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-88ba001a-2e09-4add-bbf7-e0370f476613 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.121967 Apr 19 14:02:34 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 96/292] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:02:33 2023] POST /compute/v2.1/servers => generated 406 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:02:34 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=38 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:34 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:34 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8f1a93fc-cb3a-400e-a9ca-fc456dc88094 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:34 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-8f1a93fc-cb3a-400e-a9ca-fc456dc88094 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:34 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-8f1a93fc-cb3a-400e-a9ca-fc456dc88094 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:02:34 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8f1a93fc-cb3a-400e-a9ca-fc456dc88094 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1232 microversion: 2.1 time: 0.078173 Apr 19 14:02:34 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 99/293] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:02:34 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1232 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:02:39 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-0024f7bf-941d-4346-8d4a-da9aef1f11fe req-1ab0a306-f66f-48db-bb9c-16bdfbd1a066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb235214-2700-4447-9dcf-517ebbf414cc", "tag": "787ed8af-95eb-4d0f-bb41-0cbbd78d488e"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0024f7bf-941d-4346-8d4a-da9aef1f11fe req-1ab0a306-f66f-48db-bb9c-16bdfbd1a066 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0024f7bf-941d-4346-8d4a-da9aef1f11fe req-1ab0a306-f66f-48db-bb9c-16bdfbd1a066 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:39 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-0024f7bf-941d-4346-8d4a-da9aef1f11fe req-1ab0a306-f66f-48db-bb9c-16bdfbd1a066 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-0024f7bf-941d-4346-8d4a-da9aef1f11fe req-1ab0a306-f66f-48db-bb9c-16bdfbd1a066 service nova] Creating event network-changed:787ed8af-95eb-4d0f-bb41-0cbbd78d488e for instance cb235214-2700-4447-9dcf-517ebbf414cc on user Apr 19 14:02:39 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-0024f7bf-941d-4346-8d4a-da9aef1f11fe req-1ab0a306-f66f-48db-bb9c-16bdfbd1a066 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030092 Apr 19 14:02:39 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 99/294] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:02:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:41 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-e3338f87-97e2-400d-8e9c-d8b43e50dd6b req-ba627aa8-c4e6-4c6b-aa08-6f3382c52c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb235214-2700-4447-9dcf-517ebbf414cc", "name": "network-vif-plugged", "status": "completed", "tag": "787ed8af-95eb-4d0f-bb41-0cbbd78d488e"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e3338f87-97e2-400d-8e9c-d8b43e50dd6b req-ba627aa8-c4e6-4c6b-aa08-6f3382c52c7d service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e3338f87-97e2-400d-8e9c-d8b43e50dd6b req-ba627aa8-c4e6-4c6b-aa08-6f3382c52c7d service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:41 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-e3338f87-97e2-400d-8e9c-d8b43e50dd6b req-ba627aa8-c4e6-4c6b-aa08-6f3382c52c7d service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-e3338f87-97e2-400d-8e9c-d8b43e50dd6b req-ba627aa8-c4e6-4c6b-aa08-6f3382c52c7d service nova] Creating event network-vif-plugged:787ed8af-95eb-4d0f-bb41-0cbbd78d488e for instance cb235214-2700-4447-9dcf-517ebbf414cc on user Apr 19 14:02:41 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-e3338f87-97e2-400d-8e9c-d8b43e50dd6b req-ba627aa8-c4e6-4c6b-aa08-6f3382c52c7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031458 Apr 19 14:02:41 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 97/295] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:02:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:42 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:42 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] [instance: 39b00836-b75e-499d-be70-8a56500a3ebb] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:42 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:42 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] HTTP exception thrown: Instance 39b00836-b75e-499d-be70-8a56500a3ebb could not be found. Apr 19 14:02:42 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Request method failure captured: Apr 19 14:02:42 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb HTTP/1.1 Apr 19 14:02:42 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:02:42 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:02:42 user devstack@n-api.service[61611]: Connection: close Apr 19 14:02:42 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:02:42 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:02:42 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:02:42 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:02:42 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_MeVcvnulJljy3RtTyUHVWTIVrApm4y8myKCW-7WPm-GojuqHCqg6IZ23yRe8RLyhZOVgdunO6uWvkAaQPauA4Xm6wjsuA_1yAI4J5NkZ_NOy_72k18o0xOf92yjgIKtHY7yTX4Gu2TSYfEwuJOSWJQDt454CsneR4YqKKawvzxcMg Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Project-Id: 833c753ebd4a43f3a70e30069a91f159 Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Project-Name: tempest-TestMinimumBasicScenario-1552925886 Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/833c753ebd4a43f3a70e30069a91f159"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/833c753ebd4a43f3a70e30069a91f159"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/833c753ebd4a43f3a70e30069a91f159"}]}] Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Tenant: tempest-TestMinimumBasicScenario-1552925886 Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Tenant-Id: 833c753ebd4a43f3a70e30069a91f159 Apr 19 14:02:42 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1552925886 Apr 19 14:02:42 user devstack@n-api.service[61611]: X-User: tempest-TestMinimumBasicScenario-1552925886-project-member Apr 19 14:02:42 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:02:42 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:02:42 user devstack@n-api.service[61611]: X-User-Id: 659c76db8ca8424a8c46a43936dfc7a4 Apr 19 14:02:42 user devstack@n-api.service[61611]: X-User-Name: tempest-TestMinimumBasicScenario-1552925886-project-member Apr 19 14:02:42 user devstack@n-api.service[61611]: method: > Apr 19 14:02:42 user devstack@n-api.service[61611]: exception: Instance 39b00836-b75e-499d-be70-8a56500a3ebb could not be found. Apr 19 14:02:42 user devstack@n-api.service[61611]: action_args: {'id': '39b00836-b75e-499d-be70-8a56500a3ebb'} Apr 19 14:02:42 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39b00836-b75e-499d-be70-8a56500a3ebb could not be found. Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39b00836-b75e-499d-be70-8a56500a3ebb could not be found. Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39b00836-b75e-499d-be70-8a56500a3ebb could not be found. Apr 19 14:02:42 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:02:42 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Returning 404 to user: Instance 39b00836-b75e-499d-be70-8a56500a3ebb could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:02:42 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e5c89279-afa5-402c-a100-f2793f8531d9 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb" status: 404 len: 111 microversion: 2.1 time: 0.221167 Apr 19 14:02:42 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 100/296] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:02:42 2023] GET /compute/v2.1/servers/39b00836-b75e-499d-be70-8a56500a3ebb => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:02:42 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:42 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-09c2f7b3-149a-4512-862b-9d1156feb1f3 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] Calling method '.version_select at 0x7f60de3789d0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-09c2f7b3-149a-4512-862b-9d1156feb1f3 tempest-TestMinimumBasicScenario-1552925886 tempest-TestMinimumBasicScenario-1552925886-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-667746645" status: 202 len: 0 microversion: 2.1 time: 0.023621 Apr 19 14:02:42 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 100/297] 10.0.0.210 () {62 vars in 1346 bytes} [Wed Apr 19 14:02:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-667746645 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:02:43 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-c82373c1-fea5-4ec7-9f1e-c46a1036feba req-4b83db2c-7bf5-4787-8616-a100fbbdfe52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb235214-2700-4447-9dcf-517ebbf414cc", "name": "network-vif-plugged", "status": "completed", "tag": "787ed8af-95eb-4d0f-bb41-0cbbd78d488e"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c82373c1-fea5-4ec7-9f1e-c46a1036feba req-4b83db2c-7bf5-4787-8616-a100fbbdfe52 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c82373c1-fea5-4ec7-9f1e-c46a1036feba req-4b83db2c-7bf5-4787-8616-a100fbbdfe52 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c82373c1-fea5-4ec7-9f1e-c46a1036feba req-4b83db2c-7bf5-4787-8616-a100fbbdfe52 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-c82373c1-fea5-4ec7-9f1e-c46a1036feba req-4b83db2c-7bf5-4787-8616-a100fbbdfe52 service nova] Creating event network-vif-plugged:787ed8af-95eb-4d0f-bb41-0cbbd78d488e for instance cb235214-2700-4447-9dcf-517ebbf414cc on user Apr 19 14:02:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-c82373c1-fea5-4ec7-9f1e-c46a1036feba req-4b83db2c-7bf5-4787-8616-a100fbbdfe52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029138 Apr 19 14:02:43 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 98/298] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:02:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ac851277-4a46-42c1-ba77-7f8433a12bfa tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:44 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ac851277-4a46-42c1-ba77-7f8433a12bfa tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: f17f6de2-942d-44ab-9d65-ccc1abe92dbb] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ac851277-4a46-42c1-ba77-7f8433a12bfa tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ac851277-4a46-42c1-ba77-7f8433a12bfa tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ac851277-4a46-42c1-ba77-7f8433a12bfa tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ac851277-4a46-42c1-ba77-7f8433a12bfa tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ac851277-4a46-42c1-ba77-7f8433a12bfa tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ac851277-4a46-42c1-ba77-7f8433a12bfa tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:44 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-ac851277-4a46-42c1-ba77-7f8433a12bfa tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b82a409207a14dbd96308936b12a65fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d563f8793494ae697180a5f58c11758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:02:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ac851277-4a46-42c1-ba77-7f8433a12bfa tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb" status: 200 len: 1490 microversion: 2.1 time: 0.433477 Apr 19 14:02:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 101/299] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:02:44 2023] GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb => generated 1490 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:02:46 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-15a8c4b9-a010-426e-b382-f556b57846e8 tempest-TestStampPattern-694449092 tempest-TestStampPattern-694449092-project-member] Action: 'create', calling method: .version_select at 0x7f60de3780d0>, body: {"keypair": {"name": "tempest-TestStampPattern-1530317186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2km9RU8I6uavHVx4yRGldwtazsXzxQQj7oNocN3Msb+qOSOEoOaepoUnhTNZpf+TJWtLzW3EqZeGcYx+7gWM9GPkJ21o4fKiWC4IPt3jnDa4ZtGQIesaViYjDTWEr2sA=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:46 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-15a8c4b9-a010-426e-b382-f556b57846e8 tempest-TestStampPattern-694449092 tempest-TestStampPattern-694449092-project-member] Getting quotas for project 94a86643031e4eb7be78bd69f80f1f3b. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:02:46 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-15a8c4b9-a010-426e-b382-f556b57846e8 tempest-TestStampPattern-694449092 tempest-TestStampPattern-694449092-project-member] Getting quotas for user 9a8928c0d6414135b0f35d0b403ea158 and project 94a86643031e4eb7be78bd69f80f1f3b. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:02:46 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-15a8c4b9-a010-426e-b382-f556b57846e8 tempest-TestStampPattern-694449092 tempest-TestStampPattern-694449092-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.239169 Apr 19 14:02:46 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 101/300] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:02:46 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1fd85a26-2e4b-4196-b2c5-5655381da79e tempest-TestStampPattern-694449092 tempest-TestStampPattern-694449092-project-member] Calling method '.version_select at 0x7f60de255cf0>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1fd85a26-2e4b-4196-b2c5-5655381da79e tempest-TestStampPattern-694449092 tempest-TestStampPattern-694449092-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1530317186" status: 202 len: 0 microversion: 2.1 time: 0.041892 Apr 19 14:02:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 99/301] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:02:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1530317186 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-d6c49aea-d95a-4d14-bd54-a5dab3a87cae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-d6c49aea-d95a-4d14-bd54-a5dab3a87cae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d6c49aea-d95a-4d14-bd54-a5dab3a87cae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d6c49aea-d95a-4d14-bd54-a5dab3a87cae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d6c49aea-d95a-4d14-bd54-a5dab3a87cae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d6c49aea-d95a-4d14-bd54-a5dab3a87cae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d6c49aea-d95a-4d14-bd54-a5dab3a87cae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-d6c49aea-d95a-4d14-bd54-a5dab3a87cae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:55 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-d6c49aea-d95a-4d14-bd54-a5dab3a87cae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb00927681348c08cabf5cea1edaac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806255a694c7446893131ff6de13c42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:02:55 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-d6c49aea-d95a-4d14-bd54-a5dab3a87cae tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452" status: 200 len: 1493 microversion: 2.1 time: 0.250978 Apr 19 14:02:55 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 102/302] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:02:55 2023] GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452 => generated 1493 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:02:55 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:56 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:56 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] HTTP exception thrown: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:02:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Request method failure captured: Apr 19 14:02:56 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0 HTTP/1.1 Apr 19 14:02:56 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:02:56 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:02:56 user devstack@n-api.service[61613]: Connection: close Apr 19 14:02:56 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:02:56 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:02:56 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:02:56 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:02:56 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_NCYqdYeIYUtLZia3X7RG-ub8ITKiCDTzHCgD9fyg1v8rPy7Maz_XBa9Ltr7FXuQddz9ilJuL94KrBAHoY6wmfuTcvq82grQEwxnnM7PGCoLxX8Fh26vgvQJJ2ZBuAJleLIQXYGLhNsQLkTaovNY809kdcXqgjHdqBIBDihpUSNPOc Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Project-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0606afa926de4400819fac2cce6813a7"}]}] Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Tenant-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:02:56 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:02:56 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:02:56 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:02:56 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:02:56 user devstack@n-api.service[61613]: X-User-Id: 390686e4c10c40f0b1df9b2ba9557484 Apr 19 14:02:56 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:02:56 user devstack@n-api.service[61613]: method: > Apr 19 14:02:56 user devstack@n-api.service[61613]: exception: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:02:56 user devstack@n-api.service[61613]: action_args: {'id': '36f5347a-291b-4d70-a8d9-58ca074f2ed0'} Apr 19 14:02:56 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:02:56 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:02:56 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Returning 404 to user: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:02:56 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-cba7aeee-d01d-4045-8565-3bb7cad0318c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0" status: 404 len: 111 microversion: 2.1 time: 0.202744 Apr 19 14:02:56 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 102/303] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:02:55 2023] GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:02:56 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:56 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b40ff7c7-7ac2-4a2b-b71d-247286c6cfa8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '.version_select at 0x7f60de257d00>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:56 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-b40ff7c7-7ac2-4a2b-b71d-247286c6cfa8 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815914906" status: 202 len: 0 microversion: 2.1 time: 0.026814 Apr 19 14:02:56 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 100/304] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:02:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815914906 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:02:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-1a23831a-1f17-4c0f-be0b-45df98ed0367 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Action: 'create', calling method: .version_select at 0x7f60de5e2440>, body: {"keypair": {"name": "tempest-keypair-1858775888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/dJ/BbfLz6d0sFPWaQDs7PJmELCYNpQRe0/VpiV46999rKSPwo7OVU4cXiQepZdYahrKfX1tpnKXgHA4XDx3cTNezAqKQ84Cc2c5qpQW4hqg3D7A6V/fwPV+q7xLeRpg=="}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:57 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-1a23831a-1f17-4c0f-be0b-45df98ed0367 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for project 0606afa926de4400819fac2cce6813a7. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:02:57 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-1a23831a-1f17-4c0f-be0b-45df98ed0367 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for user 390686e4c10c40f0b1df9b2ba9557484 and project 0606afa926de4400819fac2cce6813a7. Resources: {'key_pairs'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:02:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-1a23831a-1f17-4c0f-be0b-45df98ed0367 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054528 Apr 19 14:02:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 103/305] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:02:57 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:02:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-392764400", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "eccb12ee-eec2-46f3-bd4b-50363e787f6e"}], "security_groups": [{"name": "tempest-securitygroup--1074117242"}], "key_name": "tempest-keypair-1858775888", "user_data": "}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:02:58 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:02:58 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] validate_networks() for [('eccb12ee-eec2-46f3-bd4b-50363e787f6e', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for project 0606afa926de4400819fac2cce6813a7. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Getting quotas for user 390686e4c10c40f0b1df9b2ba9557484 and project 0606afa926de4400819fac2cce6813a7. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:02:59 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:02:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-f8e502c7-ebb7-474f-a794-38dfbf1c1572 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.833934 Apr 19 14:02:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 103/306] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:02:58 2023] POST /compute/v2.1/servers => generated 400 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:02:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f0436f2e-0d49-477b-a886-810b66630273 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:02:59 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f0436f2e-0d49-477b-a886-810b66630273 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:02:59 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-f0436f2e-0d49-477b-a886-810b66630273 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390686e4c10c40f0b1df9b2ba9557484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606afa926de4400819fac2cce6813a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:02:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-f0436f2e-0d49-477b-a886-810b66630273 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4" status: 200 len: 1235 microversion: 2.1 time: 0.093257 Apr 19 14:02:59 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 101/307] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:02:59 2023] GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4 => generated 1235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:03:03 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-840d7338-967d-4177-b87b-b6419e30a1a5 req-aeca3c0b-e68d-4058-a70d-5d13076908d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e06787c-2163-467f-b5ec-230be13760e4", "tag": "c4d49c6d-d51e-4a05-9830-30fb436f70da"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:03:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-840d7338-967d-4177-b87b-b6419e30a1a5 req-aeca3c0b-e68d-4058-a70d-5d13076908d0 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-840d7338-967d-4177-b87b-b6419e30a1a5 req-aeca3c0b-e68d-4058-a70d-5d13076908d0 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:03 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-840d7338-967d-4177-b87b-b6419e30a1a5 req-aeca3c0b-e68d-4058-a70d-5d13076908d0 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-840d7338-967d-4177-b87b-b6419e30a1a5 req-aeca3c0b-e68d-4058-a70d-5d13076908d0 service nova] Creating event network-changed:c4d49c6d-d51e-4a05-9830-30fb436f70da for instance 2e06787c-2163-467f-b5ec-230be13760e4 on user Apr 19 14:03:03 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-840d7338-967d-4177-b87b-b6419e30a1a5 req-aeca3c0b-e68d-4058-a70d-5d13076908d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031207 Apr 19 14:03:03 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 104/308] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:03:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:03:05 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-f0b0ad1f-ebf6-4d71-8628-86842cdc3ebe req-a4498bc0-8458-4b5a-ba6f-f328cdccd04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e06787c-2163-467f-b5ec-230be13760e4", "name": "network-vif-plugged", "status": "completed", "tag": "c4d49c6d-d51e-4a05-9830-30fb436f70da"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:03:05 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f0b0ad1f-ebf6-4d71-8628-86842cdc3ebe req-a4498bc0-8458-4b5a-ba6f-f328cdccd04f service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f0b0ad1f-ebf6-4d71-8628-86842cdc3ebe req-a4498bc0-8458-4b5a-ba6f-f328cdccd04f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:05 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-f0b0ad1f-ebf6-4d71-8628-86842cdc3ebe req-a4498bc0-8458-4b5a-ba6f-f328cdccd04f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-f0b0ad1f-ebf6-4d71-8628-86842cdc3ebe req-a4498bc0-8458-4b5a-ba6f-f328cdccd04f service nova] Creating event network-vif-plugged:c4d49c6d-d51e-4a05-9830-30fb436f70da for instance 2e06787c-2163-467f-b5ec-230be13760e4 on user Apr 19 14:03:05 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-f0b0ad1f-ebf6-4d71-8628-86842cdc3ebe req-a4498bc0-8458-4b5a-ba6f-f328cdccd04f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059546 Apr 19 14:03:05 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 104/309] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:03:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:03:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-4a382801-8d9e-402c-9d6f-2655fe20f016 req-ad18161e-db01-4b4a-b857-804f74274d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e06787c-2163-467f-b5ec-230be13760e4", "name": "network-vif-plugged", "status": "completed", "tag": "c4d49c6d-d51e-4a05-9830-30fb436f70da"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:03:07 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4a382801-8d9e-402c-9d6f-2655fe20f016 req-ad18161e-db01-4b4a-b857-804f74274d25 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4a382801-8d9e-402c-9d6f-2655fe20f016 req-ad18161e-db01-4b4a-b857-804f74274d25 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-4a382801-8d9e-402c-9d6f-2655fe20f016 req-ad18161e-db01-4b4a-b857-804f74274d25 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-4a382801-8d9e-402c-9d6f-2655fe20f016 req-ad18161e-db01-4b4a-b857-804f74274d25 service nova] Creating event network-vif-plugged:c4d49c6d-d51e-4a05-9830-30fb436f70da for instance 2e06787c-2163-467f-b5ec-230be13760e4 on user Apr 19 14:03:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-4a382801-8d9e-402c-9d6f-2655fe20f016 req-ad18161e-db01-4b4a-b857-804f74274d25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051480 Apr 19 14:03:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 102/310] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:03:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:03:09 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-00bc1987-b3b1-455c-adbc-4c22af7beebd tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1165192593"}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:03:10 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-00bc1987-b3b1-455c-adbc-4c22af7beebd tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 547f7955-94c5-48e4-8705-456f5d4c2d99] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:03:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00bc1987-b3b1-455c-adbc-4c22af7beebd tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00bc1987-b3b1-455c-adbc-4c22af7beebd tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00bc1987-b3b1-455c-adbc-4c22af7beebd tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00bc1987-b3b1-455c-adbc-4c22af7beebd tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00bc1987-b3b1-455c-adbc-4c22af7beebd tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-00bc1987-b3b1-455c-adbc-4c22af7beebd tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-00bc1987-b3b1-455c-adbc-4c22af7beebd tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99/action" status: 202 len: 52 microversion: 2.87 time: 1.260010 Apr 19 14:03:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 105/311] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 19 14:03:09 2023] POST /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99/action => generated 52 bytes in 1262 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 19 14:03:12 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:12 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:12 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c1f70138-5155-4119-b58a-33fe7133b000 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Action: 'create', calling method: .version_select at 0x7f60de333f40>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1106689667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ8Nl2KC00RPp/+rrwNA8U9lT4Nd92cP5E6FdvSrqqL6Ht64dRn3z+kUI4mf7jGwNdxg01QHCZUieVwY23lwnzNYxPweEVpFWknNCr75vnoCQPj4hdquN72c1+t0vzdlw=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:03:12 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-c1f70138-5155-4119-b58a-33fe7133b000 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Getting quotas for project cb7a8a4c01784fab8210d3e9d59dbff2. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:03:12 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-c1f70138-5155-4119-b58a-33fe7133b000 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Getting quotas for user c6bbfee1957e48c2a9c4975e753ba09f and project cb7a8a4c01784fab8210d3e9d59dbff2. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:03:12 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c1f70138-5155-4119-b58a-33fe7133b000 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.174656 Apr 19 14:03:12 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 105/312] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:03:12 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:03:14 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:14 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-27737685", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1106689667", "security_groups": [{"name": "tempest-secgroup-smoke-178008003"}], "networks": [{"uuid": "b71765ef-ae42-4d7d-a925-efe246f76b41"}]}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:03:14 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] validate_networks() for [('b71765ef-ae42-4d7d-a925-efe246f76b41', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Getting quotas for project cb7a8a4c01784fab8210d3e9d59dbff2. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Getting quotas for user c6bbfee1957e48c2a9c4975e753ba09f and project cb7a8a4c01784fab8210d3e9d59dbff2. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:03:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] [instance: b4c5fa56-fcc2-4b59-a1ee-0c352d92c001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:03:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c6d0b217-5132-4e36-a8e6-1b0aa60c5b64 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.053281 Apr 19 14:03:15 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 103/313] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:03:14 2023] POST /compute/v2.1/servers => generated 403 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:03:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c42fd784-460d-40a5-913b-06aabeddecac tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:03:15 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-c42fd784-460d-40a5-913b-06aabeddecac tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] [instance: b4c5fa56-fcc2-4b59-a1ee-0c352d92c001] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:03:15 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-c42fd784-460d-40a5-913b-06aabeddecac tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bbfee1957e48c2a9c4975e753ba09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7a8a4c01784fab8210d3e9d59dbff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:03:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c42fd784-460d-40a5-913b-06aabeddecac tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001" status: 200 len: 1255 microversion: 2.1 time: 0.062351 Apr 19 14:03:15 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 106/314] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:03:15 2023] GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 => generated 1255 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 547f7955-94c5-48e4-8705-456f5d4c2d99] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:03:16 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:03:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-392f9261-018d-4936-b702-826f872283fe tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99" status: 200 len: 1690 microversion: 2.87 time: 0.223847 Apr 19 14:03:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 106/315] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:03:16 2023] GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99 => generated 1690 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:03:18 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-d7db9850-cdf2-4850-b6ec-d17fa27c26e5 req-f27d5ca0-4fec-4838-ab72-131c0bb04ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c5fa56-fcc2-4b59-a1ee-0c352d92c001", "tag": "0dc5f146-40b1-4918-a880-dd062277cf86"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:03:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d7db9850-cdf2-4850-b6ec-d17fa27c26e5 req-f27d5ca0-4fec-4838-ab72-131c0bb04ef9 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d7db9850-cdf2-4850-b6ec-d17fa27c26e5 req-f27d5ca0-4fec-4838-ab72-131c0bb04ef9 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-d7db9850-cdf2-4850-b6ec-d17fa27c26e5 req-f27d5ca0-4fec-4838-ab72-131c0bb04ef9 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-d7db9850-cdf2-4850-b6ec-d17fa27c26e5 req-f27d5ca0-4fec-4838-ab72-131c0bb04ef9 service nova] Creating event network-changed:0dc5f146-40b1-4918-a880-dd062277cf86 for instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 on user Apr 19 14:03:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-d7db9850-cdf2-4850-b6ec-d17fa27c26e5 req-f27d5ca0-4fec-4838-ab72-131c0bb04ef9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027571 Apr 19 14:03:18 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 104/316] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:03:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:03:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-bb2aaa78-77da-47ee-b545-0001032f6d6f req-3241a680-8b00-4182-ba87-174f43f03b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c5fa56-fcc2-4b59-a1ee-0c352d92c001", "name": "network-vif-plugged", "status": "completed", "tag": "0dc5f146-40b1-4918-a880-dd062277cf86"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:03:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-bb2aaa78-77da-47ee-b545-0001032f6d6f req-3241a680-8b00-4182-ba87-174f43f03b52 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-bb2aaa78-77da-47ee-b545-0001032f6d6f req-3241a680-8b00-4182-ba87-174f43f03b52 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-bb2aaa78-77da-47ee-b545-0001032f6d6f req-3241a680-8b00-4182-ba87-174f43f03b52 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-bb2aaa78-77da-47ee-b545-0001032f6d6f req-3241a680-8b00-4182-ba87-174f43f03b52 service nova] Creating event network-vif-plugged:0dc5f146-40b1-4918-a880-dd062277cf86 for instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 on user Apr 19 14:03:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-bb2aaa78-77da-47ee-b545-0001032f6d6f req-3241a680-8b00-4182-ba87-174f43f03b52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055981 Apr 19 14:03:20 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 107/317] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:03:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:03:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-10ad99f6-7c1c-45db-a46b-a347a369adb2 req-b460afa4-d78d-438b-9170-2a80fa53abf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c5fa56-fcc2-4b59-a1ee-0c352d92c001", "name": "network-vif-plugged", "status": "completed", "tag": "0dc5f146-40b1-4918-a880-dd062277cf86"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:03:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-10ad99f6-7c1c-45db-a46b-a347a369adb2 req-b460afa4-d78d-438b-9170-2a80fa53abf8 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-10ad99f6-7c1c-45db-a46b-a347a369adb2 req-b460afa4-d78d-438b-9170-2a80fa53abf8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-10ad99f6-7c1c-45db-a46b-a347a369adb2 req-b460afa4-d78d-438b-9170-2a80fa53abf8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-10ad99f6-7c1c-45db-a46b-a347a369adb2 req-b460afa4-d78d-438b-9170-2a80fa53abf8 service nova] Creating event network-vif-plugged:0dc5f146-40b1-4918-a880-dd062277cf86 for instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 on user Apr 19 14:03:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-10ad99f6-7c1c-45db-a46b-a347a369adb2 req-b460afa4-d78d-438b-9170-2a80fa53abf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027520 Apr 19 14:03:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 107/318] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:03:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:03:24 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-06c17564-41eb-4284-8303-77fa4791ef65 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:03:24 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-06c17564-41eb-4284-8303-77fa4791ef65 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:03:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-06c17564-41eb-4284-8303-77fa4791ef65 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-06c17564-41eb-4284-8303-77fa4791ef65 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-06c17564-41eb-4284-8303-77fa4791ef65 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-06c17564-41eb-4284-8303-77fa4791ef65 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-06c17564-41eb-4284-8303-77fa4791ef65 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-06c17564-41eb-4284-8303-77fa4791ef65 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:25 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-06c17564-41eb-4284-8303-77fa4791ef65 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:03:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-06c17564-41eb-4284-8303-77fa4791ef65 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1539 microversion: 2.1 time: 0.265957 Apr 19 14:03:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 105/319] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:03:24 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1539 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a6585d5a-8806-4f3c-bb35-7f94c88b8b9b tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a6585d5a-8806-4f3c-bb35-7f94c88b8b9b tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: 7c628cf8-58bb-4a59-adc0-929a7ead5e00] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6585d5a-8806-4f3c-bb35-7f94c88b8b9b tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6585d5a-8806-4f3c-bb35-7f94c88b8b9b tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6585d5a-8806-4f3c-bb35-7f94c88b8b9b tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6585d5a-8806-4f3c-bb35-7f94c88b8b9b tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6585d5a-8806-4f3c-bb35-7f94c88b8b9b tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-a6585d5a-8806-4f3c-bb35-7f94c88b8b9b tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:44 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-a6585d5a-8806-4f3c-bb35-7f94c88b8b9b tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b82a409207a14dbd96308936b12a65fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d563f8793494ae697180a5f58c11758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:03:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a6585d5a-8806-4f3c-bb35-7f94c88b8b9b tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00" status: 200 len: 1504 microversion: 2.1 time: 0.260096 Apr 19 14:03:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 108/320] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:03:44 2023] GET /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00 => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-3e39d3e1-77a7-43a0-b451-39d57c432dd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-3e39d3e1-77a7-43a0-b451-39d57c432dd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3e39d3e1-77a7-43a0-b451-39d57c432dd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3e39d3e1-77a7-43a0-b451-39d57c432dd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3e39d3e1-77a7-43a0-b451-39d57c432dd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3e39d3e1-77a7-43a0-b451-39d57c432dd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3e39d3e1-77a7-43a0-b451-39d57c432dd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-3e39d3e1-77a7-43a0-b451-39d57c432dd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:49 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-3e39d3e1-77a7-43a0-b451-39d57c432dd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390686e4c10c40f0b1df9b2ba9557484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606afa926de4400819fac2cce6813a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:03:49 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-3e39d3e1-77a7-43a0-b451-39d57c432dd0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4" status: 200 len: 1545 microversion: 2.1 time: 0.223070 Apr 19 14:03:49 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 108/321] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:03:49 2023] GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4 => generated 1545 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1c0ca631-cb9c-40d2-b7bc-22c28daf413e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1c0ca631-cb9c-40d2-b7bc-22c28daf413e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=12 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1c0ca631-cb9c-40d2-b7bc-22c28daf413e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1c0ca631-cb9c-40d2-b7bc-22c28daf413e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1c0ca631-cb9c-40d2-b7bc-22c28daf413e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1c0ca631-cb9c-40d2-b7bc-22c28daf413e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1c0ca631-cb9c-40d2-b7bc-22c28daf413e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1c0ca631-cb9c-40d2-b7bc-22c28daf413e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:03:55 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-1c0ca631-cb9c-40d2-b7bc-22c28daf413e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb00927681348c08cabf5cea1edaac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806255a694c7446893131ff6de13c42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:03:55 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1c0ca631-cb9c-40d2-b7bc-22c28daf413e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452" status: 200 len: 1493 microversion: 2.1 time: 0.229006 Apr 19 14:03:55 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 106/322] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:03:55 2023] GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452 => generated 1493 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:04:05 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-92357fe2-dceb-461c-a283-54fbbfebdf52 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:05 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-92357fe2-dceb-461c-a283-54fbbfebdf52 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] [instance: b4c5fa56-fcc2-4b59-a1ee-0c352d92c001] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:05 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:05 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-92357fe2-dceb-461c-a283-54fbbfebdf52 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-92357fe2-dceb-461c-a283-54fbbfebdf52 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-92357fe2-dceb-461c-a283-54fbbfebdf52 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-92357fe2-dceb-461c-a283-54fbbfebdf52 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-92357fe2-dceb-461c-a283-54fbbfebdf52 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:05 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-92357fe2-dceb-461c-a283-54fbbfebdf52 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:06 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-92357fe2-dceb-461c-a283-54fbbfebdf52 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bbfee1957e48c2a9c4975e753ba09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7a8a4c01784fab8210d3e9d59dbff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:04:06 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-92357fe2-dceb-461c-a283-54fbbfebdf52 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001" status: 200 len: 1566 microversion: 2.1 time: 0.549297 Apr 19 14:04:06 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 109/323] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:04:05 2023] GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 => generated 1566 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:04:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-735740642", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "4dcdc911-3648-46b3-8c6e-9727e5375516", "destination_type": "volume"}], "networks": [{"uuid": "6c5edc8e-b8c1-4e48-bd8d-acf10a103739"}]}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:04:16 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:16 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:16 user devstack@n-api.service[61613]: DEBUG nova.network.neutron [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] validate_networks() for [('6c5edc8e-b8c1-4e48-bd8d-acf10a103739', None, None, None, None, None)] {{(pid=61613) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Flavor limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Image limits 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Flavor pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Image pref 0:0:0 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG nova.virt.hardware [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Getting quotas for project 2bf567425cb7480e93f114268dc22713. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Getting quotas for user 46f11c11cc4f46e3810f06e974a387c8 and project 2bf567425cb7480e93f114268dc22713. Resources: {'ram', 'instances', 'cores'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Going to run 1 instances... {{(pid=61613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:04:17 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:04:17 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-96afbbfc-538d-4e79-8798-c15cff67eb0c tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.575178 Apr 19 14:04:17 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 109/324] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 14:04:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 14:04:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-60ab9f47-3c5c-43a6-a6a8-6d70aabe6b61 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:17 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-60ab9f47-3c5c-43a6-a6a8-6d70aabe6b61 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:17 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:17 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-60ab9f47-3c5c-43a6-a6a8-6d70aabe6b61 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:04:17 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-60ab9f47-3c5c-43a6-a6a8-6d70aabe6b61 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:04:17 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-60ab9f47-3c5c-43a6-a6a8-6d70aabe6b61 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:04:17 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-60ab9f47-3c5c-43a6-a6a8-6d70aabe6b61 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd656936-7656-4e89-8a1f-9b43584c5624" status: 200 len: 1394 microversion: 2.87 time: 0.080127 Apr 19 14:04:17 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 107/325] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:04:17 2023] GET /compute/v2.1/servers/bd656936-7656-4e89-8a1f-9b43584c5624 => generated 1394 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:04:20 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-f8e25ff1-a21e-4d2e-8b81-73b05b606526 req-2079e53b-06c2-4694-be12-797396c86959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd656936-7656-4e89-8a1f-9b43584c5624", "tag": "ed3dc356-f6e9-457f-ad2e-0e03f16356c6"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:04:20 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:20 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f8e25ff1-a21e-4d2e-8b81-73b05b606526 req-2079e53b-06c2-4694-be12-797396c86959 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f8e25ff1-a21e-4d2e-8b81-73b05b606526 req-2079e53b-06c2-4694-be12-797396c86959 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:20 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-f8e25ff1-a21e-4d2e-8b81-73b05b606526 req-2079e53b-06c2-4694-be12-797396c86959 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-f8e25ff1-a21e-4d2e-8b81-73b05b606526 req-2079e53b-06c2-4694-be12-797396c86959 service nova] Creating event network-changed:ed3dc356-f6e9-457f-ad2e-0e03f16356c6 for instance bd656936-7656-4e89-8a1f-9b43584c5624 on user Apr 19 14:04:20 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-f8e25ff1-a21e-4d2e-8b81-73b05b606526 req-2079e53b-06c2-4694-be12-797396c86959 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049819 Apr 19 14:04:20 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 110/326] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:04:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:04:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-e1c5f30e-8b47-4006-aabf-202524fa1b62 req-2dfab35d-f737-4cca-a7b7-994547a5627a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd656936-7656-4e89-8a1f-9b43584c5624", "name": "network-vif-deleted", "tag": "ed3dc356-f6e9-457f-ad2e-0e03f16356c6"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:04:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e1c5f30e-8b47-4006-aabf-202524fa1b62 req-2dfab35d-f737-4cca-a7b7-994547a5627a service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e1c5f30e-8b47-4006-aabf-202524fa1b62 req-2dfab35d-f737-4cca-a7b7-994547a5627a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-e1c5f30e-8b47-4006-aabf-202524fa1b62 req-2dfab35d-f737-4cca-a7b7-994547a5627a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.compute.server_external_events [req-e1c5f30e-8b47-4006-aabf-202524fa1b62 req-2dfab35d-f737-4cca-a7b7-994547a5627a service nova] Unable to find a host for instance bd656936-7656-4e89-8a1f-9b43584c5624. Dropping event network-vif-deleted {{(pid=61613) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 19 14:04:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-e1c5f30e-8b47-4006-aabf-202524fa1b62 req-2dfab35d-f737-4cca-a7b7-994547a5627a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.027002 Apr 19 14:04:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 110/327] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:04:22 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 19 14:04:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-fd72f61f-7e03-4353-8af4-48c6dcfd1f71 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:25 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-fd72f61f-7e03-4353-8af4-48c6dcfd1f71 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd72f61f-7e03-4353-8af4-48c6dcfd1f71 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd72f61f-7e03-4353-8af4-48c6dcfd1f71 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd72f61f-7e03-4353-8af4-48c6dcfd1f71 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd72f61f-7e03-4353-8af4-48c6dcfd1f71 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd72f61f-7e03-4353-8af4-48c6dcfd1f71 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-fd72f61f-7e03-4353-8af4-48c6dcfd1f71 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-fd72f61f-7e03-4353-8af4-48c6dcfd1f71 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.160826 Apr 19 14:04:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 108/328] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:04:25 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc/os-interface => generated 283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:04:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-95b95d99-9006-4c48-b2f8-8cc7f2aba5a8 req-549f5a4a-7958-4a87-ae90-adc722fe8bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb235214-2700-4447-9dcf-517ebbf414cc", "tag": "787ed8af-95eb-4d0f-bb41-0cbbd78d488e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:04:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-95b95d99-9006-4c48-b2f8-8cc7f2aba5a8 req-549f5a4a-7958-4a87-ae90-adc722fe8bba service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-95b95d99-9006-4c48-b2f8-8cc7f2aba5a8 req-549f5a4a-7958-4a87-ae90-adc722fe8bba service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-95b95d99-9006-4c48-b2f8-8cc7f2aba5a8 req-549f5a4a-7958-4a87-ae90-adc722fe8bba service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-95b95d99-9006-4c48-b2f8-8cc7f2aba5a8 req-549f5a4a-7958-4a87-ae90-adc722fe8bba service nova] Creating event network-changed:787ed8af-95eb-4d0f-bb41-0cbbd78d488e for instance cb235214-2700-4447-9dcf-517ebbf414cc on user Apr 19 14:04:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-95b95d99-9006-4c48-b2f8-8cc7f2aba5a8 req-549f5a4a-7958-4a87-ae90-adc722fe8bba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032231 Apr 19 14:04:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 111/329] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:04:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 14:04:26 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b33de924-e903-4a6a-8a3c-b05d9078d797 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:26 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-b33de924-e903-4a6a-8a3c-b05d9078d797 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b33de924-e903-4a6a-8a3c-b05d9078d797 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b33de924-e903-4a6a-8a3c-b05d9078d797 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b33de924-e903-4a6a-8a3c-b05d9078d797 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b33de924-e903-4a6a-8a3c-b05d9078d797 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b33de924-e903-4a6a-8a3c-b05d9078d797 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:26 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-b33de924-e903-4a6a-8a3c-b05d9078d797 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:26 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-b33de924-e903-4a6a-8a3c-b05d9078d797 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:04:26 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b33de924-e903-4a6a-8a3c-b05d9078d797 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1539 microversion: 2.1 time: 0.148299 Apr 19 14:04:26 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 111/330] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:04:26 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:04:26 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-6b6703c3-c4b0-4346-8582-f6a4bf741f18 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:26 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-6b6703c3-c4b0-4346-8582-f6a4bf741f18 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6b6703c3-c4b0-4346-8582-f6a4bf741f18 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6b6703c3-c4b0-4346-8582-f6a4bf741f18 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6b6703c3-c4b0-4346-8582-f6a4bf741f18 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6b6703c3-c4b0-4346-8582-f6a4bf741f18 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6b6703c3-c4b0-4346-8582-f6a4bf741f18 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:26 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-6b6703c3-c4b0-4346-8582-f6a4bf741f18 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:26 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-6b6703c3-c4b0-4346-8582-f6a4bf741f18 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:04:26 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-6b6703c3-c4b0-4346-8582-f6a4bf741f18 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1539 microversion: 2.1 time: 0.151321 Apr 19 14:04:26 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 109/331] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:04:26 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1539 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-859cd280-e616-434a-9a54-2b08db80e43d tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-859cd280-e616-434a-9a54-2b08db80e43d tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: f17f6de2-942d-44ab-9d65-ccc1abe92dbb] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-859cd280-e616-434a-9a54-2b08db80e43d tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-859cd280-e616-434a-9a54-2b08db80e43d tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-859cd280-e616-434a-9a54-2b08db80e43d tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-859cd280-e616-434a-9a54-2b08db80e43d tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-859cd280-e616-434a-9a54-2b08db80e43d tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-859cd280-e616-434a-9a54-2b08db80e43d tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:48 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-859cd280-e616-434a-9a54-2b08db80e43d tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: f17f6de2-942d-44ab-9d65-ccc1abe92dbb] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:04:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-859cd280-e616-434a-9a54-2b08db80e43d tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb" status: 204 len: 0 microversion: 2.1 time: 0.143311 Apr 19 14:04:48 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 112/332] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:04:48 2023] DELETE /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fa07a27f-de0c-4d85-9966-317d907a71f2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-fa07a27f-de0c-4d85-9966-317d907a71f2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: f17f6de2-942d-44ab-9d65-ccc1abe92dbb] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=10 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fa07a27f-de0c-4d85-9966-317d907a71f2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fa07a27f-de0c-4d85-9966-317d907a71f2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fa07a27f-de0c-4d85-9966-317d907a71f2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fa07a27f-de0c-4d85-9966-317d907a71f2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fa07a27f-de0c-4d85-9966-317d907a71f2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fa07a27f-de0c-4d85-9966-317d907a71f2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:48 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-fa07a27f-de0c-4d85-9966-317d907a71f2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b82a409207a14dbd96308936b12a65fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d563f8793494ae697180a5f58c11758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:04:48 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-fa07a27f-de0c-4d85-9966-317d907a71f2 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb" status: 200 len: 1496 microversion: 2.1 time: 0.316999 Apr 19 14:04:48 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 112/333] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:04:48 2023] GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb => generated 1496 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:04:48 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-c2b8ff7f-e121-425e-8fa8-17f32d83e40b req-b3f55a9f-13d3-4910-a240-3ecfade953d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17f6de2-942d-44ab-9d65-ccc1abe92dbb", "name": "network-vif-unplugged", "status": "completed", "tag": "dd36104d-1964-49d9-8371-84bd895cc49c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:04:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:48 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:04:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c2b8ff7f-e121-425e-8fa8-17f32d83e40b req-b3f55a9f-13d3-4910-a240-3ecfade953d7 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c2b8ff7f-e121-425e-8fa8-17f32d83e40b req-b3f55a9f-13d3-4910-a240-3ecfade953d7 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:48 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-c2b8ff7f-e121-425e-8fa8-17f32d83e40b req-b3f55a9f-13d3-4910-a240-3ecfade953d7 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-c2b8ff7f-e121-425e-8fa8-17f32d83e40b req-b3f55a9f-13d3-4910-a240-3ecfade953d7 service nova] Creating event network-vif-unplugged:dd36104d-1964-49d9-8371-84bd895cc49c for instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb on user Apr 19 14:04:48 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-c2b8ff7f-e121-425e-8fa8-17f32d83e40b req-b3f55a9f-13d3-4910-a240-3ecfade953d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036009 Apr 19 14:04:48 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 110/334] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:04:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:04:49 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-cce66799-7eb5-4484-b5db-61a5953b4b7e req-4c32dcc7-1182-4bc3-a1cb-0bce03618244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17f6de2-942d-44ab-9d65-ccc1abe92dbb", "name": "network-vif-deleted", "tag": "dd36104d-1964-49d9-8371-84bd895cc49c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:04:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cce66799-7eb5-4484-b5db-61a5953b4b7e req-4c32dcc7-1182-4bc3-a1cb-0bce03618244 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cce66799-7eb5-4484-b5db-61a5953b4b7e req-4c32dcc7-1182-4bc3-a1cb-0bce03618244 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:49 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-cce66799-7eb5-4484-b5db-61a5953b4b7e req-4c32dcc7-1182-4bc3-a1cb-0bce03618244 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-cce66799-7eb5-4484-b5db-61a5953b4b7e req-4c32dcc7-1182-4bc3-a1cb-0bce03618244 service nova] Creating event network-vif-deleted:dd36104d-1964-49d9-8371-84bd895cc49c for instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb on user Apr 19 14:04:49 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-cce66799-7eb5-4484-b5db-61a5953b4b7e req-4c32dcc7-1182-4bc3-a1cb-0bce03618244 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027534 Apr 19 14:04:49 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 113/335] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:04:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:04:49 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-a3378eb5-8116-4825-8395-56ee9939016e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:49 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-a3378eb5-8116-4825-8395-56ee9939016e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3378eb5-8116-4825-8395-56ee9939016e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3378eb5-8116-4825-8395-56ee9939016e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3378eb5-8116-4825-8395-56ee9939016e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3378eb5-8116-4825-8395-56ee9939016e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3378eb5-8116-4825-8395-56ee9939016e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:49 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-a3378eb5-8116-4825-8395-56ee9939016e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:50 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-a3378eb5-8116-4825-8395-56ee9939016e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.153547 Apr 19 14:04:50 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 113/336] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:04:49 2023] GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4/os-interface => generated 283 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:04:50 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-29a328c7-a537-4e90-9642-fa8ee2800273 req-2f8fd2dc-368e-4dd2-89df-86bb6a8479d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17f6de2-942d-44ab-9d65-ccc1abe92dbb", "name": "network-vif-plugged", "status": "completed", "tag": "dd36104d-1964-49d9-8371-84bd895cc49c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:04:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-29a328c7-a537-4e90-9642-fa8ee2800273 req-2f8fd2dc-368e-4dd2-89df-86bb6a8479d3 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-29a328c7-a537-4e90-9642-fa8ee2800273 req-2f8fd2dc-368e-4dd2-89df-86bb6a8479d3 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:50 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-29a328c7-a537-4e90-9642-fa8ee2800273 req-2f8fd2dc-368e-4dd2-89df-86bb6a8479d3 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:50 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-29a328c7-a537-4e90-9642-fa8ee2800273 req-2f8fd2dc-368e-4dd2-89df-86bb6a8479d3 service nova] Creating event network-vif-plugged:dd36104d-1964-49d9-8371-84bd895cc49c for instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb on user Apr 19 14:04:50 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-29a328c7-a537-4e90-9642-fa8ee2800273 req-2f8fd2dc-368e-4dd2-89df-86bb6a8479d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029596 Apr 19 14:04:50 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 111/337] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:04:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:04:51 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-6115295f-abf5-4e11-a0f5-0e45a48a42a2 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:51 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-6115295f-abf5-4e11-a0f5-0e45a48a42a2 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6115295f-abf5-4e11-a0f5-0e45a48a42a2 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6115295f-abf5-4e11-a0f5-0e45a48a42a2 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6115295f-abf5-4e11-a0f5-0e45a48a42a2 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6115295f-abf5-4e11-a0f5-0e45a48a42a2 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6115295f-abf5-4e11-a0f5-0e45a48a42a2 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:51 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6115295f-abf5-4e11-a0f5-0e45a48a42a2 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:51 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-6115295f-abf5-4e11-a0f5-0e45a48a42a2 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4/ips" status: 200 len: 108 microversion: 2.1 time: 0.041815 Apr 19 14:04:51 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 114/338] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:04:51 2023] GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4/ips => generated 108 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:04:52 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-6dea1e3d-4010-45b2-9f8a-596a2792150c req-7f08f150-19bf-4765-b4aa-19b8b159a91e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e06787c-2163-467f-b5ec-230be13760e4", "tag": "c4d49c6d-d51e-4a05-9830-30fb436f70da"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:04:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6dea1e3d-4010-45b2-9f8a-596a2792150c req-7f08f150-19bf-4765-b4aa-19b8b159a91e service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6dea1e3d-4010-45b2-9f8a-596a2792150c req-7f08f150-19bf-4765-b4aa-19b8b159a91e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:52 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-6dea1e3d-4010-45b2-9f8a-596a2792150c req-7f08f150-19bf-4765-b4aa-19b8b159a91e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-6dea1e3d-4010-45b2-9f8a-596a2792150c req-7f08f150-19bf-4765-b4aa-19b8b159a91e service nova] Creating event network-changed:c4d49c6d-d51e-4a05-9830-30fb436f70da for instance 2e06787c-2163-467f-b5ec-230be13760e4 on user Apr 19 14:04:52 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-6dea1e3d-4010-45b2-9f8a-596a2792150c req-7f08f150-19bf-4765-b4aa-19b8b159a91e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030794 Apr 19 14:04:52 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 114/339] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:04:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:04:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-1b574b2f-e7ce-4ece-a7fa-b2a74e18b4b7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:52 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1b574b2f-e7ce-4ece-a7fa-b2a74e18b4b7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b574b2f-e7ce-4ece-a7fa-b2a74e18b4b7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b574b2f-e7ce-4ece-a7fa-b2a74e18b4b7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b574b2f-e7ce-4ece-a7fa-b2a74e18b4b7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b574b2f-e7ce-4ece-a7fa-b2a74e18b4b7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b574b2f-e7ce-4ece-a7fa-b2a74e18b4b7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:52 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-1b574b2f-e7ce-4ece-a7fa-b2a74e18b4b7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:52 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-1b574b2f-e7ce-4ece-a7fa-b2a74e18b4b7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:04:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-1b574b2f-e7ce-4ece-a7fa-b2a74e18b4b7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4" status: 204 len: 0 microversion: 2.1 time: 0.119330 Apr 19 14:04:52 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 112/340] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:04:52 2023] DELETE /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:04:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-fdd9de89-4707-4cfb-b151-c19ae5793d7e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:52 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-fdd9de89-4707-4cfb-b151-c19ae5793d7e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fdd9de89-4707-4cfb-b151-c19ae5793d7e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fdd9de89-4707-4cfb-b151-c19ae5793d7e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fdd9de89-4707-4cfb-b151-c19ae5793d7e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fdd9de89-4707-4cfb-b151-c19ae5793d7e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fdd9de89-4707-4cfb-b151-c19ae5793d7e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-fdd9de89-4707-4cfb-b151-c19ae5793d7e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:53 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-fdd9de89-4707-4cfb-b151-c19ae5793d7e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390686e4c10c40f0b1df9b2ba9557484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606afa926de4400819fac2cce6813a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:04:53 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-fdd9de89-4707-4cfb-b151-c19ae5793d7e tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4" status: 200 len: 1551 microversion: 2.1 time: 0.695678 Apr 19 14:04:53 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 115/341] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:04:52 2023] GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4 => generated 1551 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:04:54 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-9907ce1e-41ea-40bd-beb4-08ec1b9ab4aa req-089fe8f0-0891-464f-9a4d-b3e9c852bee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e06787c-2163-467f-b5ec-230be13760e4", "name": "network-vif-deleted", "tag": "c4d49c6d-d51e-4a05-9830-30fb436f70da"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:04:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-9907ce1e-41ea-40bd-beb4-08ec1b9ab4aa req-089fe8f0-0891-464f-9a4d-b3e9c852bee6 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-9907ce1e-41ea-40bd-beb4-08ec1b9ab4aa req-089fe8f0-0891-464f-9a4d-b3e9c852bee6 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:54 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-9907ce1e-41ea-40bd-beb4-08ec1b9ab4aa req-089fe8f0-0891-464f-9a4d-b3e9c852bee6 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-9907ce1e-41ea-40bd-beb4-08ec1b9ab4aa req-089fe8f0-0891-464f-9a4d-b3e9c852bee6 service nova] Creating event network-vif-deleted:c4d49c6d-d51e-4a05-9830-30fb436f70da for instance 2e06787c-2163-467f-b5ec-230be13760e4 on user Apr 19 14:04:54 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-9907ce1e-41ea-40bd-beb4-08ec1b9ab4aa req-089fe8f0-0891-464f-9a4d-b3e9c852bee6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030095 Apr 19 14:04:54 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:04:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:04:54 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-dc155a1a-e994-44ff-8a49-75e95c1f4178 req-545797b6-e4e1-4af4-8ff8-75b9530b5767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e06787c-2163-467f-b5ec-230be13760e4", "name": "network-vif-unplugged", "status": "completed", "tag": "c4d49c6d-d51e-4a05-9830-30fb436f70da"}, {"server_uuid": "2e06787c-2163-467f-b5ec-230be13760e4", "name": "network-vif-plugged", "status": "completed", "tag": "c4d49c6d-d51e-4a05-9830-30fb436f70da"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:04:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-dc155a1a-e994-44ff-8a49-75e95c1f4178 req-545797b6-e4e1-4af4-8ff8-75b9530b5767 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-dc155a1a-e994-44ff-8a49-75e95c1f4178 req-545797b6-e4e1-4af4-8ff8-75b9530b5767 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:54 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-dc155a1a-e994-44ff-8a49-75e95c1f4178 req-545797b6-e4e1-4af4-8ff8-75b9530b5767 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-dc155a1a-e994-44ff-8a49-75e95c1f4178 req-545797b6-e4e1-4af4-8ff8-75b9530b5767 service nova] Creating event network-vif-unplugged:c4d49c6d-d51e-4a05-9830-30fb436f70da for instance 2e06787c-2163-467f-b5ec-230be13760e4 on user Apr 19 14:04:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-dc155a1a-e994-44ff-8a49-75e95c1f4178 req-545797b6-e4e1-4af4-8ff8-75b9530b5767 service nova] Creating event network-vif-plugged:c4d49c6d-d51e-4a05-9830-30fb436f70da for instance 2e06787c-2163-467f-b5ec-230be13760e4 on user Apr 19 14:04:54 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-dc155a1a-e994-44ff-8a49-75e95c1f4178 req-545797b6-e4e1-4af4-8ff8-75b9530b5767 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030194 Apr 19 14:04:54 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 113/343] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:04:54 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:04:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7197b795-d21b-4c00-a69e-585acda4ac8e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:04:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-7197b795-d21b-4c00-a69e-585acda4ac8e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:04:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7197b795-d21b-4c00-a69e-585acda4ac8e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7197b795-d21b-4c00-a69e-585acda4ac8e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7197b795-d21b-4c00-a69e-585acda4ac8e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7197b795-d21b-4c00-a69e-585acda4ac8e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:04:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7197b795-d21b-4c00-a69e-585acda4ac8e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:04:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7197b795-d21b-4c00-a69e-585acda4ac8e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:04:57 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-7197b795-d21b-4c00-a69e-585acda4ac8e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb00927681348c08cabf5cea1edaac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806255a694c7446893131ff6de13c42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:04:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7197b795-d21b-4c00-a69e-585acda4ac8e tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452" status: 200 len: 1493 microversion: 2.1 time: 0.241350 Apr 19 14:04:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 116/344] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:04:57 2023] GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452 => generated 1493 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=14 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-d16c3a2a-e9ed-482c-b22b-9cf93ef09f7b tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-d16c3a2a-e9ed-482c-b22b-9cf93ef09f7b tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] [instance: b4c5fa56-fcc2-4b59-a1ee-0c352d92c001] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d16c3a2a-e9ed-482c-b22b-9cf93ef09f7b tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d16c3a2a-e9ed-482c-b22b-9cf93ef09f7b tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d16c3a2a-e9ed-482c-b22b-9cf93ef09f7b tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d16c3a2a-e9ed-482c-b22b-9cf93ef09f7b tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d16c3a2a-e9ed-482c-b22b-9cf93ef09f7b tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-d16c3a2a-e9ed-482c-b22b-9cf93ef09f7b tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:06 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-d16c3a2a-e9ed-482c-b22b-9cf93ef09f7b tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bbfee1957e48c2a9c4975e753ba09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7a8a4c01784fab8210d3e9d59dbff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:06 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-d16c3a2a-e9ed-482c-b22b-9cf93ef09f7b tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001" status: 200 len: 1566 microversion: 2.1 time: 0.251378 Apr 19 14:05:06 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 116/345] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:06 2023] GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 => generated 1566 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG nova.objects.instance [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lazy-loading 'fault' on Instance uuid bd656936-7656-4e89-8a1f-9b43584c5624 {{(pid=61612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:07 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-ff24f5e7-ef75-47bf-be57-1bed062eb38d tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd656936-7656-4e89-8a1f-9b43584c5624" status: 200 len: 1649 microversion: 2.87 time: 0.107083 Apr 19 14:05:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 114/346] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:05:07 2023] GET /compute/v2.1/servers/bd656936-7656-4e89-8a1f-9b43584c5624 => generated 1649 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] Doing local delete in cell 2620343c-c8d1-48e6-ac23-7775ee8493ea(cell1) {{(pid=61611) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:07 user devstack@n-api.service[61611]: WARNING nova.compute.api [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] instance's host None is down, deleting from database Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] deallocate_for_instance() {{(pid=61611) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] Instance cache missing network info. {{(pid=61611) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] Updating instance_info_cache with network_info: [] {{(pid=61611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 19 14:05:07 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61611) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 19 14:05:07 user devstack@n-api.service[61611]: WARNING nova.compute.api [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 19 14:05:07 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-317bddda-4389-4a0a-8f2a-2293390477e9 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:07 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-317bddda-4389-4a0a-8f2a-2293390477e9 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] [instance: b4c5fa56-fcc2-4b59-a1ee-0c352d92c001] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-317bddda-4389-4a0a-8f2a-2293390477e9 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-317bddda-4389-4a0a-8f2a-2293390477e9 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-317bddda-4389-4a0a-8f2a-2293390477e9 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-317bddda-4389-4a0a-8f2a-2293390477e9 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-317bddda-4389-4a0a-8f2a-2293390477e9 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:07 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-317bddda-4389-4a0a-8f2a-2293390477e9 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:07 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-317bddda-4389-4a0a-8f2a-2293390477e9 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] [instance: b4c5fa56-fcc2-4b59-a1ee-0c352d92c001] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:05:08 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-df3a5634-6567-4c88-adbe-17256206afda tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd656936-7656-4e89-8a1f-9b43584c5624" status: 204 len: 0 microversion: 2.87 time: 0.415126 Apr 19 14:05:08 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 117/347] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:05:07 2023] DELETE /compute/v2.1/servers/bd656936-7656-4e89-8a1f-9b43584c5624 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: bd656936-7656-4e89-8a1f-9b43584c5624] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-317bddda-4389-4a0a-8f2a-2293390477e9 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001" status: 204 len: 0 microversion: 2.1 time: 0.117462 Apr 19 14:05:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] HTTP exception thrown: Instance bd656936-7656-4e89-8a1f-9b43584c5624 could not be found. Apr 19 14:05:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 117/348] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:05:07 2023] DELETE /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Request method failure captured: Apr 19 14:05:08 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/bd656936-7656-4e89-8a1f-9b43584c5624 HTTP/1.1 Apr 19 14:05:08 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:05:08 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:05:08 user devstack@n-api.service[61612]: Connection: close Apr 19 14:05:08 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:05:08 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:05:08 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:05:08 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:05:08 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_NH9TxQ-AlgSG8fcsUjQ3kA9xtDSUjM-NMnFsny7ZG-UVjg-B4v1X-HPHooMNSE0t31PxlO2nZ6Qq6_el7ctQwVs6UlFW86AWP38_Jo3ktdXabUQhXzf_zJZOVF1kBfJ-TMSGj52EIcIIyMtwaF1ZZdkE7_Tm4b0i6OMGMnX2NgxCM Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Project-Id: 2bf567425cb7480e93f114268dc22713 Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bf567425cb7480e93f114268dc22713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bf567425cb7480e93f114268dc22713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2bf567425cb7480e93f114268dc22713"}]}] Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Tenant-Id: 2bf567425cb7480e93f114268dc22713 Apr 19 14:05:08 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:05:08 user devstack@n-api.service[61612]: X-User: tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member Apr 19 14:05:08 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:05:08 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:05:08 user devstack@n-api.service[61612]: X-User-Id: 46f11c11cc4f46e3810f06e974a387c8 Apr 19 14:05:08 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member Apr 19 14:05:08 user devstack@n-api.service[61612]: method: > Apr 19 14:05:08 user devstack@n-api.service[61612]: exception: Instance bd656936-7656-4e89-8a1f-9b43584c5624 could not be found. Apr 19 14:05:08 user devstack@n-api.service[61612]: action_args: {'id': 'bd656936-7656-4e89-8a1f-9b43584c5624'} Apr 19 14:05:08 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd656936-7656-4e89-8a1f-9b43584c5624 could not be found. Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd656936-7656-4e89-8a1f-9b43584c5624 could not be found. Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd656936-7656-4e89-8a1f-9b43584c5624 could not be found. Apr 19 14:05:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Returning 404 to user: Instance bd656936-7656-4e89-8a1f-9b43584c5624 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-cd25848b-aa87-42b3-a955-c9095f73987a tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd656936-7656-4e89-8a1f-9b43584c5624" status: 404 len: 111 microversion: 2.87 time: 0.029220 Apr 19 14:05:08 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 115/349] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:05:08 2023] GET /compute/v2.1/servers/bd656936-7656-4e89-8a1f-9b43584c5624 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:05:08 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-965e2b0e-d047-42c7-91ef-9036fcdf86c7 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:08 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-965e2b0e-d047-42c7-91ef-9036fcdf86c7 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] [instance: b4c5fa56-fcc2-4b59-a1ee-0c352d92c001] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-965e2b0e-d047-42c7-91ef-9036fcdf86c7 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-965e2b0e-d047-42c7-91ef-9036fcdf86c7 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-965e2b0e-d047-42c7-91ef-9036fcdf86c7 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-965e2b0e-d047-42c7-91ef-9036fcdf86c7 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-965e2b0e-d047-42c7-91ef-9036fcdf86c7 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:08 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-965e2b0e-d047-42c7-91ef-9036fcdf86c7 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-74b2f8c9-004a-48bd-accb-866b3c8691be tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:08 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-74b2f8c9-004a-48bd-accb-866b3c8691be tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 547f7955-94c5-48e4-8705-456f5d4c2d99] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-74b2f8c9-004a-48bd-accb-866b3c8691be tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-74b2f8c9-004a-48bd-accb-866b3c8691be tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-74b2f8c9-004a-48bd-accb-866b3c8691be tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-74b2f8c9-004a-48bd-accb-866b3c8691be tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-74b2f8c9-004a-48bd-accb-866b3c8691be tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-74b2f8c9-004a-48bd-accb-866b3c8691be tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:08 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-74b2f8c9-004a-48bd-accb-866b3c8691be tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 547f7955-94c5-48e4-8705-456f5d4c2d99] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-142c217b-ba2a-4de6-9231-a752b2a3092a req-c5e2cc51-a7e7-406a-b670-430589420eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c5fa56-fcc2-4b59-a1ee-0c352d92c001", "name": "network-vif-unplugged", "status": "completed", "tag": "0dc5f146-40b1-4918-a880-dd062277cf86"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-142c217b-ba2a-4de6-9231-a752b2a3092a req-c5e2cc51-a7e7-406a-b670-430589420eca service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-142c217b-ba2a-4de6-9231-a752b2a3092a req-c5e2cc51-a7e7-406a-b670-430589420eca service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-142c217b-ba2a-4de6-9231-a752b2a3092a req-c5e2cc51-a7e7-406a-b670-430589420eca service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-142c217b-ba2a-4de6-9231-a752b2a3092a req-c5e2cc51-a7e7-406a-b670-430589420eca service nova] Creating event network-vif-unplugged:0dc5f146-40b1-4918-a880-dd062277cf86 for instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 on user Apr 19 14:05:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-142c217b-ba2a-4de6-9231-a752b2a3092a req-c5e2cc51-a7e7-406a-b670-430589420eca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029822 Apr 19 14:05:08 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 116/350] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:08 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-965e2b0e-d047-42c7-91ef-9036fcdf86c7 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bbfee1957e48c2a9c4975e753ba09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7a8a4c01784fab8210d3e9d59dbff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-74b2f8c9-004a-48bd-accb-866b3c8691be tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99" status: 204 len: 0 microversion: 2.87 time: 0.176053 Apr 19 14:05:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 118/351] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:05:08 2023] DELETE /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 14:05:08 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-965e2b0e-d047-42c7-91ef-9036fcdf86c7 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001" status: 200 len: 1572 microversion: 2.1 time: 0.381180 Apr 19 14:05:08 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 118/352] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:08 2023] GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 => generated 1572 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 547f7955-94c5-48e4-8705-456f5d4c2d99] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:08 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-7cee15cb-fa85-4b00-b63b-50572bba40ea tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99" status: 200 len: 1696 microversion: 2.87 time: 0.417809 Apr 19 14:05:08 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 117/353] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:05:08 2023] GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99 => generated 1696 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:05:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-1b6a024b-3971-464c-84b8-be0dedb5ceda req-3a776506-bda3-4939-9e38-cb3aec0f3702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c5fa56-fcc2-4b59-a1ee-0c352d92c001", "name": "network-vif-deleted", "tag": "0dc5f146-40b1-4918-a880-dd062277cf86"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1b6a024b-3971-464c-84b8-be0dedb5ceda req-3a776506-bda3-4939-9e38-cb3aec0f3702 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1b6a024b-3971-464c-84b8-be0dedb5ceda req-3a776506-bda3-4939-9e38-cb3aec0f3702 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-1b6a024b-3971-464c-84b8-be0dedb5ceda req-3a776506-bda3-4939-9e38-cb3aec0f3702 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-1b6a024b-3971-464c-84b8-be0dedb5ceda req-3a776506-bda3-4939-9e38-cb3aec0f3702 service nova] Creating event network-vif-deleted:0dc5f146-40b1-4918-a880-dd062277cf86 for instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 on user Apr 19 14:05:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-1b6a024b-3971-464c-84b8-be0dedb5ceda req-3a776506-bda3-4939-9e38-cb3aec0f3702 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040126 Apr 19 14:05:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 119/354] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:10 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-3b9c7706-8b15-46db-ac02-1b74fefb35a0 req-20f34d92-23e0-40e9-90c9-4ed08a358d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c5fa56-fcc2-4b59-a1ee-0c352d92c001", "name": "network-vif-plugged", "status": "completed", "tag": "0dc5f146-40b1-4918-a880-dd062277cf86"}, {"server_uuid": "547f7955-94c5-48e4-8705-456f5d4c2d99", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb1b519-4623-46ca-90c7-9ed496dcae15"}, {"server_uuid": "547f7955-94c5-48e4-8705-456f5d4c2d99", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1b519-4623-46ca-90c7-9ed496dcae15"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-3b9c7706-8b15-46db-ac02-1b74fefb35a0 req-20f34d92-23e0-40e9-90c9-4ed08a358d34 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-3b9c7706-8b15-46db-ac02-1b74fefb35a0 req-20f34d92-23e0-40e9-90c9-4ed08a358d34 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:10 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-3b9c7706-8b15-46db-ac02-1b74fefb35a0 req-20f34d92-23e0-40e9-90c9-4ed08a358d34 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-3b9c7706-8b15-46db-ac02-1b74fefb35a0 req-20f34d92-23e0-40e9-90c9-4ed08a358d34 service nova] Creating event network-vif-plugged:0dc5f146-40b1-4918-a880-dd062277cf86 for instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 on user Apr 19 14:05:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-3b9c7706-8b15-46db-ac02-1b74fefb35a0 req-20f34d92-23e0-40e9-90c9-4ed08a358d34 service nova] Creating event network-vif-unplugged:2eb1b519-4623-46ca-90c7-9ed496dcae15 for instance 547f7955-94c5-48e4-8705-456f5d4c2d99 on user Apr 19 14:05:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-3b9c7706-8b15-46db-ac02-1b74fefb35a0 req-20f34d92-23e0-40e9-90c9-4ed08a358d34 service nova] Creating event network-vif-plugged:2eb1b519-4623-46ca-90c7-9ed496dcae15 for instance 547f7955-94c5-48e4-8705-456f5d4c2d99 on user Apr 19 14:05:10 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-3b9c7706-8b15-46db-ac02-1b74fefb35a0 req-20f34d92-23e0-40e9-90c9-4ed08a358d34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.037561 Apr 19 14:05:10 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:10 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:11 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-f22bfa46-7f17-49ac-8ca0-f2fa981d9942 req-76884bdf-d63c-4e0d-9365-3a5632f6198b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547f7955-94c5-48e4-8705-456f5d4c2d99", "name": "network-vif-deleted", "tag": "2eb1b519-4623-46ca-90c7-9ed496dcae15"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f22bfa46-7f17-49ac-8ca0-f2fa981d9942 req-76884bdf-d63c-4e0d-9365-3a5632f6198b service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f22bfa46-7f17-49ac-8ca0-f2fa981d9942 req-76884bdf-d63c-4e0d-9365-3a5632f6198b service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-f22bfa46-7f17-49ac-8ca0-f2fa981d9942 req-76884bdf-d63c-4e0d-9365-3a5632f6198b service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-f22bfa46-7f17-49ac-8ca0-f2fa981d9942 req-76884bdf-d63c-4e0d-9365-3a5632f6198b service nova] Creating event network-vif-deleted:2eb1b519-4623-46ca-90c7-9ed496dcae15 for instance 547f7955-94c5-48e4-8705-456f5d4c2d99 on user Apr 19 14:05:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-f22bfa46-7f17-49ac-8ca0-f2fa981d9942 req-76884bdf-d63c-4e0d-9365-3a5632f6198b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026872 Apr 19 14:05:11 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 118/356] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:16 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ae6a1df2-16fa-4f92-9ef8-6fa97e9da69d tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:16 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-ae6a1df2-16fa-4f92-9ef8-6fa97e9da69d tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae6a1df2-16fa-4f92-9ef8-6fa97e9da69d tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae6a1df2-16fa-4f92-9ef8-6fa97e9da69d tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae6a1df2-16fa-4f92-9ef8-6fa97e9da69d tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae6a1df2-16fa-4f92-9ef8-6fa97e9da69d tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae6a1df2-16fa-4f92-9ef8-6fa97e9da69d tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:16 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ae6a1df2-16fa-4f92-9ef8-6fa97e9da69d tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:16 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-ae6a1df2-16fa-4f92-9ef8-6fa97e9da69d tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-ae6a1df2-16fa-4f92-9ef8-6fa97e9da69d tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.218633 Apr 19 14:05:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 120/357] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:16 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:05:16 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-4d9f7816-7876-42a0-b602-b286b82e2011 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:16 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-4d9f7816-7876-42a0-b602-b286b82e2011 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4d9f7816-7876-42a0-b602-b286b82e2011 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4d9f7816-7876-42a0-b602-b286b82e2011 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4d9f7816-7876-42a0-b602-b286b82e2011 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4d9f7816-7876-42a0-b602-b286b82e2011 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4d9f7816-7876-42a0-b602-b286b82e2011 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:16 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-4d9f7816-7876-42a0-b602-b286b82e2011 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:16 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-4d9f7816-7876-42a0-b602-b286b82e2011 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:16 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-4d9f7816-7876-42a0-b602-b286b82e2011 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.211703 Apr 19 14:05:16 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 120/358] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:16 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=16 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=20 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: f17f6de2-942d-44ab-9d65-ccc1abe92dbb] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] HTTP exception thrown: Instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb could not be found. Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Request method failure captured: Apr 19 14:05:38 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb HTTP/1.1 Apr 19 14:05:38 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:05:38 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:05:38 user devstack@n-api.service[61612]: Connection: close Apr 19 14:05:38 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:05:38 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:05:38 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:05:38 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:05:38 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_Ph8ml_Ca3BBEnokFWpuOEH9JoMw3L0hOcdOU3cbvpKPRkoI2MIM55371avBRnmrgkKDwo-lFl3LrGHT9uj33t5p8Vzm9dPBIbtYxkAF44gNBwbo4UeUumonR4IyamJdXqktOvDVOX46Cmzm3uk8bm0H5cPfwJGnDRNBdfMM3lTn0k Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Project-Id: 6d563f8793494ae697180a5f58c11758 Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2046718136 Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d563f8793494ae697180a5f58c11758"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d563f8793494ae697180a5f58c11758"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d563f8793494ae697180a5f58c11758"}]}] Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2046718136 Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Tenant-Id: 6d563f8793494ae697180a5f58c11758 Apr 19 14:05:38 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2046718136 Apr 19 14:05:38 user devstack@n-api.service[61612]: X-User: tempest-ServerRescueNegativeTestJSON-2046718136-project-member Apr 19 14:05:38 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:05:38 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:05:38 user devstack@n-api.service[61612]: X-User-Id: b82a409207a14dbd96308936b12a65fa Apr 19 14:05:38 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2046718136-project-member Apr 19 14:05:38 user devstack@n-api.service[61612]: method: > Apr 19 14:05:38 user devstack@n-api.service[61612]: exception: Instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb could not be found. Apr 19 14:05:38 user devstack@n-api.service[61612]: action_args: {'id': 'f17f6de2-942d-44ab-9d65-ccc1abe92dbb'} Apr 19 14:05:38 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb could not be found. Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb could not be found. Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb could not be found. Apr 19 14:05:38 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:38 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Returning 404 to user: Instance f17f6de2-942d-44ab-9d65-ccc1abe92dbb could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:38 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-510a4087-7533-46c5-8429-5407caf73025 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb" status: 404 len: 111 microversion: 2.1 time: 0.207117 Apr 19 14:05:38 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 119/359] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:38 2023] GET /compute/v2.1/servers/f17f6de2-942d-44ab-9d65-ccc1abe92dbb => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-f4911416-bb61-48bd-9f3e-84d4a4814f32 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f4911416-bb61-48bd-9f3e-84d4a4814f32 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: 7c628cf8-58bb-4a59-adc0-929a7ead5e00] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f4911416-bb61-48bd-9f3e-84d4a4814f32 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f4911416-bb61-48bd-9f3e-84d4a4814f32 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f4911416-bb61-48bd-9f3e-84d4a4814f32 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f4911416-bb61-48bd-9f3e-84d4a4814f32 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f4911416-bb61-48bd-9f3e-84d4a4814f32 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-f4911416-bb61-48bd-9f3e-84d4a4814f32 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:38 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-f4911416-bb61-48bd-9f3e-84d4a4814f32 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: 7c628cf8-58bb-4a59-adc0-929a7ead5e00] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:05:38 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-f4911416-bb61-48bd-9f3e-84d4a4814f32 tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00" status: 204 len: 0 microversion: 2.1 time: 0.127340 Apr 19 14:05:38 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 121/360] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:05:38 2023] DELETE /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:05:38 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-94932b21-ff46-4ba2-a205-9ea8cd46a64a tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:38 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-94932b21-ff46-4ba2-a205-9ea8cd46a64a tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: 7c628cf8-58bb-4a59-adc0-929a7ead5e00] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:38 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:38 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-94932b21-ff46-4ba2-a205-9ea8cd46a64a tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-94932b21-ff46-4ba2-a205-9ea8cd46a64a tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-94932b21-ff46-4ba2-a205-9ea8cd46a64a tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-94932b21-ff46-4ba2-a205-9ea8cd46a64a tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-94932b21-ff46-4ba2-a205-9ea8cd46a64a tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:38 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-94932b21-ff46-4ba2-a205-9ea8cd46a64a tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:39 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-94932b21-ff46-4ba2-a205-9ea8cd46a64a tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b82a409207a14dbd96308936b12a65fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d563f8793494ae697180a5f58c11758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:39 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-94932b21-ff46-4ba2-a205-9ea8cd46a64a tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00" status: 200 len: 1510 microversion: 2.1 time: 0.268956 Apr 19 14:05:39 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:38 2023] GET /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00 => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:05:39 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-6ce9fe0f-b476-4f0b-84c0-6e549d09cec3 req-300e36e6-bf4b-42d8-9174-1bbcce7d8e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c628cf8-58bb-4a59-adc0-929a7ead5e00", "name": "network-vif-unplugged", "status": "completed", "tag": "26bc9256-e181-4ca9-a223-69c8e86df070"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6ce9fe0f-b476-4f0b-84c0-6e549d09cec3 req-300e36e6-bf4b-42d8-9174-1bbcce7d8e4e service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6ce9fe0f-b476-4f0b-84c0-6e549d09cec3 req-300e36e6-bf4b-42d8-9174-1bbcce7d8e4e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:39 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-6ce9fe0f-b476-4f0b-84c0-6e549d09cec3 req-300e36e6-bf4b-42d8-9174-1bbcce7d8e4e service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-6ce9fe0f-b476-4f0b-84c0-6e549d09cec3 req-300e36e6-bf4b-42d8-9174-1bbcce7d8e4e service nova] Creating event network-vif-unplugged:26bc9256-e181-4ca9-a223-69c8e86df070 for instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 on user Apr 19 14:05:39 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-6ce9fe0f-b476-4f0b-84c0-6e549d09cec3 req-300e36e6-bf4b-42d8-9174-1bbcce7d8e4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101747 Apr 19 14:05:39 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 120/362] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:40 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-31d17e34-89c9-4a35-8a86-26b012a91d8f req-3f8e844c-44a1-44f3-adba-e287faf4be33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c628cf8-58bb-4a59-adc0-929a7ead5e00", "name": "network-vif-deleted", "tag": "26bc9256-e181-4ca9-a223-69c8e86df070"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-31d17e34-89c9-4a35-8a86-26b012a91d8f req-3f8e844c-44a1-44f3-adba-e287faf4be33 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-31d17e34-89c9-4a35-8a86-26b012a91d8f req-3f8e844c-44a1-44f3-adba-e287faf4be33 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:40 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-31d17e34-89c9-4a35-8a86-26b012a91d8f req-3f8e844c-44a1-44f3-adba-e287faf4be33 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:40 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-31d17e34-89c9-4a35-8a86-26b012a91d8f req-3f8e844c-44a1-44f3-adba-e287faf4be33 service nova] Creating event network-vif-deleted:26bc9256-e181-4ca9-a223-69c8e86df070 for instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 on user Apr 19 14:05:40 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-31d17e34-89c9-4a35-8a86-26b012a91d8f req-3f8e844c-44a1-44f3-adba-e287faf4be33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027510 Apr 19 14:05:40 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 122/363] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:41 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-53592297-a1f0-4a8e-b9bc-5da74d2114ce req-49f57756-1ce6-48fc-b860-2239484bdd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c628cf8-58bb-4a59-adc0-929a7ead5e00", "name": "network-vif-plugged", "status": "completed", "tag": "26bc9256-e181-4ca9-a223-69c8e86df070"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-53592297-a1f0-4a8e-b9bc-5da74d2114ce req-49f57756-1ce6-48fc-b860-2239484bdd04 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-53592297-a1f0-4a8e-b9bc-5da74d2114ce req-49f57756-1ce6-48fc-b860-2239484bdd04 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:41 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-53592297-a1f0-4a8e-b9bc-5da74d2114ce req-49f57756-1ce6-48fc-b860-2239484bdd04 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-53592297-a1f0-4a8e-b9bc-5da74d2114ce req-49f57756-1ce6-48fc-b860-2239484bdd04 service nova] Creating event network-vif-plugged:26bc9256-e181-4ca9-a223-69c8e86df070 for instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 on user Apr 19 14:05:41 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-53592297-a1f0-4a8e-b9bc-5da74d2114ce req-49f57756-1ce6-48fc-b860-2239484bdd04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035818 Apr 19 14:05:41 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 122/364] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:43 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:43 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:43 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] HTTP exception thrown: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:43 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Request method failure captured: Apr 19 14:05:43 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4 HTTP/1.1 Apr 19 14:05:43 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:05:43 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:05:43 user devstack@n-api.service[61612]: Connection: close Apr 19 14:05:43 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:05:43 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:05:43 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:05:43 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:05:43 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_NCYqdYeIYUtLZia3X7RG-ub8ITKiCDTzHCgD9fyg1v8rPy7Maz_XBa9Ltr7FXuQddz9ilJuL94KrBAHoY6wmfuTcvq82grQEwxnnM7PGCoLxX8Fh26vgvQJJ2ZBuAJleLIQXYGLhNsQLkTaovNY809kdcXqgjHdqBIBDihpUSNPOc Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Project-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0606afa926de4400819fac2cce6813a7"}]}] Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Tenant-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:43 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:43 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:43 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:05:43 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:05:43 user devstack@n-api.service[61612]: X-User-Id: 390686e4c10c40f0b1df9b2ba9557484 Apr 19 14:05:43 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:43 user devstack@n-api.service[61612]: method: > Apr 19 14:05:43 user devstack@n-api.service[61612]: exception: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:43 user devstack@n-api.service[61612]: action_args: {'id': '2e06787c-2163-467f-b5ec-230be13760e4'} Apr 19 14:05:43 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:43 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:43 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Returning 404 to user: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:43 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5e68cb99-267c-44d9-8a9a-6ef5b28ca7aa tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4" status: 404 len: 111 microversion: 2.1 time: 0.029788 Apr 19 14:05:43 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 121/365] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:43 2023] GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:43 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c651e36b-bfc8-47e4-a4aa-a25bea9fb4db tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '.version_select at 0x7f60de3792d0>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:43 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c651e36b-bfc8-47e4-a4aa-a25bea9fb4db tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858775888" status: 202 len: 0 microversion: 2.1 time: 0.024901 Apr 19 14:05:43 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 123/366] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 14:05:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858775888 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] HTTP exception thrown: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Request method failure captured: Apr 19 14:05:44 user devstack@n-api.service[61611]: request: DELETE /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4 HTTP/1.1 Apr 19 14:05:44 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:05:44 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:05:44 user devstack@n-api.service[61611]: Connection: close Apr 19 14:05:44 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:05:44 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:05:44 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:05:44 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:05:44 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_NCYqdYeIYUtLZia3X7RG-ub8ITKiCDTzHCgD9fyg1v8rPy7Maz_XBa9Ltr7FXuQddz9ilJuL94KrBAHoY6wmfuTcvq82grQEwxnnM7PGCoLxX8Fh26vgvQJJ2ZBuAJleLIQXYGLhNsQLkTaovNY809kdcXqgjHdqBIBDihpUSNPOc Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Project-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0606afa926de4400819fac2cce6813a7"}]}] Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Tenant-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:44 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:05:44 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:05:44 user devstack@n-api.service[61611]: X-User-Id: 390686e4c10c40f0b1df9b2ba9557484 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:44 user devstack@n-api.service[61611]: method: > Apr 19 14:05:44 user devstack@n-api.service[61611]: exception: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61611]: action_args: {'id': '2e06787c-2163-467f-b5ec-230be13760e4'} Apr 19 14:05:44 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Returning 404 to user: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-3111a0f0-b92b-4a75-96d3-f5bc83d6f50b tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4" status: 404 len: 111 microversion: 2.1 time: 0.027345 Apr 19 14:05:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 123/367] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:05:44 2023] DELETE /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 2e06787c-2163-467f-b5ec-230be13760e4] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] HTTP exception thrown: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Request method failure captured: Apr 19 14:05:44 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4 HTTP/1.1 Apr 19 14:05:44 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:05:44 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:05:44 user devstack@n-api.service[61612]: Connection: close Apr 19 14:05:44 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:05:44 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:05:44 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:05:44 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:05:44 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_NCYqdYeIYUtLZia3X7RG-ub8ITKiCDTzHCgD9fyg1v8rPy7Maz_XBa9Ltr7FXuQddz9ilJuL94KrBAHoY6wmfuTcvq82grQEwxnnM7PGCoLxX8Fh26vgvQJJ2ZBuAJleLIQXYGLhNsQLkTaovNY809kdcXqgjHdqBIBDihpUSNPOc Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Project-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0606afa926de4400819fac2cce6813a7"}]}] Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Tenant-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:44 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:05:44 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:05:44 user devstack@n-api.service[61612]: X-User-Id: 390686e4c10c40f0b1df9b2ba9557484 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:44 user devstack@n-api.service[61612]: method: > Apr 19 14:05:44 user devstack@n-api.service[61612]: exception: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61612]: action_args: {'id': '2e06787c-2163-467f-b5ec-230be13760e4'} Apr 19 14:05:44 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Returning 404 to user: Instance 2e06787c-2163-467f-b5ec-230be13760e4 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-09fe9fd3-b11f-456b-82a7-d80d32602f0a tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4" status: 404 len: 111 microversion: 2.1 time: 0.026667 Apr 19 14:05:44 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 122/368] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:44 2023] GET /compute/v2.1/servers/2e06787c-2163-467f-b5ec-230be13760e4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] HTTP exception thrown: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Request method failure captured: Apr 19 14:05:44 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0 HTTP/1.1 Apr 19 14:05:44 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:05:44 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:05:44 user devstack@n-api.service[61613]: Connection: close Apr 19 14:05:44 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:05:44 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:05:44 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:05:44 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:05:44 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_NCYqdYeIYUtLZia3X7RG-ub8ITKiCDTzHCgD9fyg1v8rPy7Maz_XBa9Ltr7FXuQddz9ilJuL94KrBAHoY6wmfuTcvq82grQEwxnnM7PGCoLxX8Fh26vgvQJJ2ZBuAJleLIQXYGLhNsQLkTaovNY809kdcXqgjHdqBIBDihpUSNPOc Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Project-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0606afa926de4400819fac2cce6813a7"}]}] Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Tenant-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:44 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:44 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:05:44 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:05:44 user devstack@n-api.service[61613]: X-User-Id: 390686e4c10c40f0b1df9b2ba9557484 Apr 19 14:05:44 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:44 user devstack@n-api.service[61613]: method: > Apr 19 14:05:44 user devstack@n-api.service[61613]: exception: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61613]: action_args: {'id': '36f5347a-291b-4d70-a8d9-58ca074f2ed0'} Apr 19 14:05:44 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Returning 404 to user: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:44 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-eb3b1c6c-8a18-4769-9277-bd350290882c tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0" status: 404 len: 111 microversion: 2.1 time: 0.030438 Apr 19 14:05:44 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 124/369] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:05:44 2023] DELETE /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: 36f5347a-291b-4d70-a8d9-58ca074f2ed0] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] HTTP exception thrown: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Request method failure captured: Apr 19 14:05:44 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0 HTTP/1.1 Apr 19 14:05:44 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:05:44 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:05:44 user devstack@n-api.service[61611]: Connection: close Apr 19 14:05:44 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:05:44 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:05:44 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:05:44 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:05:44 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_NCYqdYeIYUtLZia3X7RG-ub8ITKiCDTzHCgD9fyg1v8rPy7Maz_XBa9Ltr7FXuQddz9ilJuL94KrBAHoY6wmfuTcvq82grQEwxnnM7PGCoLxX8Fh26vgvQJJ2ZBuAJleLIQXYGLhNsQLkTaovNY809kdcXqgjHdqBIBDihpUSNPOc Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Project-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0606afa926de4400819fac2cce6813a7"}]}] Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Tenant-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:44 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:05:44 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:05:44 user devstack@n-api.service[61611]: X-User-Id: 390686e4c10c40f0b1df9b2ba9557484 Apr 19 14:05:44 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:44 user devstack@n-api.service[61611]: method: > Apr 19 14:05:44 user devstack@n-api.service[61611]: exception: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61611]: action_args: {'id': '36f5347a-291b-4d70-a8d9-58ca074f2ed0'} Apr 19 14:05:44 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Returning 404 to user: Instance 36f5347a-291b-4d70-a8d9-58ca074f2ed0 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-9e1d2c30-aa0a-43e1-9887-1d1f76f79fef tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0" status: 404 len: 111 microversion: 2.1 time: 0.028693 Apr 19 14:05:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 124/370] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:44 2023] GET /compute/v2.1/servers/36f5347a-291b-4d70-a8d9-58ca074f2ed0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] HTTP exception thrown: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Request method failure captured: Apr 19 14:05:44 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759 HTTP/1.1 Apr 19 14:05:44 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:05:44 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:05:44 user devstack@n-api.service[61612]: Connection: close Apr 19 14:05:44 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:05:44 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:05:44 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:05:44 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:05:44 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_NCYqdYeIYUtLZia3X7RG-ub8ITKiCDTzHCgD9fyg1v8rPy7Maz_XBa9Ltr7FXuQddz9ilJuL94KrBAHoY6wmfuTcvq82grQEwxnnM7PGCoLxX8Fh26vgvQJJ2ZBuAJleLIQXYGLhNsQLkTaovNY809kdcXqgjHdqBIBDihpUSNPOc Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Project-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0606afa926de4400819fac2cce6813a7"}]}] Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Tenant-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:44 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:05:44 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:05:44 user devstack@n-api.service[61612]: X-User-Id: 390686e4c10c40f0b1df9b2ba9557484 Apr 19 14:05:44 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:44 user devstack@n-api.service[61612]: method: > Apr 19 14:05:44 user devstack@n-api.service[61612]: exception: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61612]: action_args: {'id': 'c98d2742-2a0f-4004-b3ad-bd387ed40759'} Apr 19 14:05:44 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:05:44 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Returning 404 to user: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-505f7656-c014-4cf7-b105-556d81b91ba7 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759" status: 404 len: 111 microversion: 2.1 time: 0.027207 Apr 19 14:05:44 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 123/371] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:05:44 2023] DELETE /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] [instance: c98d2742-2a0f-4004-b3ad-bd387ed40759] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] HTTP exception thrown: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:05:45 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Request method failure captured: Apr 19 14:05:45 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759 HTTP/1.1 Apr 19 14:05:45 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:05:45 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:05:45 user devstack@n-api.service[61613]: Connection: close Apr 19 14:05:45 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:05:45 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:05:45 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:05:45 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:05:45 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_NCYqdYeIYUtLZia3X7RG-ub8ITKiCDTzHCgD9fyg1v8rPy7Maz_XBa9Ltr7FXuQddz9ilJuL94KrBAHoY6wmfuTcvq82grQEwxnnM7PGCoLxX8Fh26vgvQJJ2ZBuAJleLIQXYGLhNsQLkTaovNY809kdcXqgjHdqBIBDihpUSNPOc Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Project-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0606afa926de4400819fac2cce6813a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0606afa926de4400819fac2cce6813a7"}]}] Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Tenant-Id: 0606afa926de4400819fac2cce6813a7 Apr 19 14:05:45 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1445397700 Apr 19 14:05:45 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:45 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:05:45 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:05:45 user devstack@n-api.service[61613]: X-User-Id: 390686e4c10c40f0b1df9b2ba9557484 Apr 19 14:05:45 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeNegativeTest-1445397700-project-member Apr 19 14:05:45 user devstack@n-api.service[61613]: method: > Apr 19 14:05:45 user devstack@n-api.service[61613]: exception: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:05:45 user devstack@n-api.service[61613]: action_args: {'id': 'c98d2742-2a0f-4004-b3ad-bd387ed40759'} Apr 19 14:05:45 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. Apr 19 14:05:45 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:45 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] Returning 404 to user: Instance c98d2742-2a0f-4004-b3ad-bd387ed40759 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-92c68751-c4c3-4308-ab83-f4e8aecdafa0 tempest-AttachVolumeNegativeTest-1445397700 tempest-AttachVolumeNegativeTest-1445397700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759" status: 404 len: 111 microversion: 2.1 time: 0.026291 Apr 19 14:05:45 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 125/372] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:44 2023] GET /compute/v2.1/servers/c98d2742-2a0f-4004-b3ad-bd387ed40759 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-681161781", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "networks": [{"uuid": "65415407-a653-471c-b53c-2c199a7e4625"}]}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] validate_networks() for [('65415407-a653-471c-b53c-2c199a7e4625', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Getting quotas for project df547379af574462b674110f513ecf8f. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Getting quotas for user ef68344e8c354b0d9a826ebb6587174b and project df547379af574462b674110f513ecf8f. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:05:52 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] [instance: eea34ad1-a903-42ca-8fb4-9d3662c2e4fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:05:52 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e6bc16cb-a7c3-49ab-8d3c-d60f3c0d8410 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.714846 Apr 19 14:05:52 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 125/373] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:05:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:05:52 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-58539034-8eed-4f5f-8690-d613e9ac6070 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:52 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-58539034-8eed-4f5f-8690-d613e9ac6070 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] [instance: eea34ad1-a903-42ca-8fb4-9d3662c2e4fd] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:52 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-58539034-8eed-4f5f-8690-d613e9ac6070 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef68344e8c354b0d9a826ebb6587174b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df547379af574462b674110f513ecf8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:52 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-58539034-8eed-4f5f-8690-d613e9ac6070 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd" status: 200 len: 1207 microversion: 2.1 time: 0.060045 Apr 19 14:05:52 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 124/374] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:52 2023] GET /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd => generated 1207 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:05:55 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-5503f70b-8d81-47c8-83b1-5c9bd8554c5d req-16e5e9be-fbdb-410c-bc64-56298380cedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea34ad1-a903-42ca-8fb4-9d3662c2e4fd", "tag": "6a5ddb40-85bc-4e2e-bdd4-bdad086c650c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:55 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:55 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5503f70b-8d81-47c8-83b1-5c9bd8554c5d req-16e5e9be-fbdb-410c-bc64-56298380cedb service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5503f70b-8d81-47c8-83b1-5c9bd8554c5d req-16e5e9be-fbdb-410c-bc64-56298380cedb service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:55 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-5503f70b-8d81-47c8-83b1-5c9bd8554c5d req-16e5e9be-fbdb-410c-bc64-56298380cedb service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-5503f70b-8d81-47c8-83b1-5c9bd8554c5d req-16e5e9be-fbdb-410c-bc64-56298380cedb service nova] Creating event network-changed:6a5ddb40-85bc-4e2e-bdd4-bdad086c650c for instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd on user Apr 19 14:05:55 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-5503f70b-8d81-47c8-83b1-5c9bd8554c5d req-16e5e9be-fbdb-410c-bc64-56298380cedb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036625 Apr 19 14:05:55 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 126/375] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-806ac62a-40d8-487d-b215-bd2f812e3a26 req-bb1d17c9-b820-4300-a15c-3e0e94fe57e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea34ad1-a903-42ca-8fb4-9d3662c2e4fd", "name": "network-vif-plugged", "status": "completed", "tag": "6a5ddb40-85bc-4e2e-bdd4-bdad086c650c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-806ac62a-40d8-487d-b215-bd2f812e3a26 req-bb1d17c9-b820-4300-a15c-3e0e94fe57e8 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-806ac62a-40d8-487d-b215-bd2f812e3a26 req-bb1d17c9-b820-4300-a15c-3e0e94fe57e8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-806ac62a-40d8-487d-b215-bd2f812e3a26 req-bb1d17c9-b820-4300-a15c-3e0e94fe57e8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-806ac62a-40d8-487d-b215-bd2f812e3a26 req-bb1d17c9-b820-4300-a15c-3e0e94fe57e8 service nova] Creating event network-vif-plugged:6a5ddb40-85bc-4e2e-bdd4-bdad086c650c for instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd on user Apr 19 14:05:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-806ac62a-40d8-487d-b215-bd2f812e3a26 req-bb1d17c9-b820-4300-a15c-3e0e94fe57e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032272 Apr 19 14:05:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 126/376] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: 478b7934-6a66-4630-b756-521846ab8230] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=10 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] HTTP exception thrown: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Request method failure captured: Apr 19 14:05:57 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230 HTTP/1.1 Apr 19 14:05:57 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:05:57 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:05:57 user devstack@n-api.service[61612]: Connection: close Apr 19 14:05:57 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:05:57 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:05:57 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:05:57 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:05:57 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_M-dOEQ-4NBT4IixUWMW4Q_XRKqMM1rQypK-oJsBSGH_M8decPNRw1YBaLt4cA8hzjFi4aNWA1mhw2-7Z2rDyVY1sf25VgCwFUxteYsW3trJwQMPTJ0NH1k1V6laIhblLnZ9wF3iIRLgwGQ2pouoQxVqo2XyZSFWjW3Cn8ig0RBy-s Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Project-Id: 806255a694c7446893131ff6de13c42d Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/806255a694c7446893131ff6de13c42d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/806255a694c7446893131ff6de13c42d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/806255a694c7446893131ff6de13c42d"}]}] Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Tenant: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Tenant-Id: 806255a694c7446893131ff6de13c42d Apr 19 14:05:57 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:05:57 user devstack@n-api.service[61612]: X-User: tempest-ServersNegativeTestJSON-1629002614-project-member Apr 19 14:05:57 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:05:57 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:05:57 user devstack@n-api.service[61612]: X-User-Id: 9bb00927681348c08cabf5cea1edaac2 Apr 19 14:05:57 user devstack@n-api.service[61612]: X-User-Name: tempest-ServersNegativeTestJSON-1629002614-project-member Apr 19 14:05:57 user devstack@n-api.service[61612]: method: > Apr 19 14:05:57 user devstack@n-api.service[61612]: exception: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:05:57 user devstack@n-api.service[61612]: action_args: {'id': '478b7934-6a66-4630-b756-521846ab8230'} Apr 19 14:05:57 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:05:57 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Returning 404 to user: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:57 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9e37fc52-e0e1-40f5-9c86-2a8288949ddf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230" status: 404 len: 111 microversion: 2.1 time: 0.032566 Apr 19 14:05:57 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 125/377] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:05:57 2023] DELETE /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:57 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:57 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: 478b7934-6a66-4630-b756-521846ab8230] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:57 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] HTTP exception thrown: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:05:57 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Request method failure captured: Apr 19 14:05:57 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230 HTTP/1.1 Apr 19 14:05:57 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:05:57 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:05:57 user devstack@n-api.service[61613]: Connection: close Apr 19 14:05:57 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:05:57 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:05:57 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:05:57 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:05:57 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_M-dOEQ-4NBT4IixUWMW4Q_XRKqMM1rQypK-oJsBSGH_M8decPNRw1YBaLt4cA8hzjFi4aNWA1mhw2-7Z2rDyVY1sf25VgCwFUxteYsW3trJwQMPTJ0NH1k1V6laIhblLnZ9wF3iIRLgwGQ2pouoQxVqo2XyZSFWjW3Cn8ig0RBy-s Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Project-Id: 806255a694c7446893131ff6de13c42d Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/806255a694c7446893131ff6de13c42d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/806255a694c7446893131ff6de13c42d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/806255a694c7446893131ff6de13c42d"}]}] Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Tenant: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Tenant-Id: 806255a694c7446893131ff6de13c42d Apr 19 14:05:57 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:05:57 user devstack@n-api.service[61613]: X-User: tempest-ServersNegativeTestJSON-1629002614-project-member Apr 19 14:05:57 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:05:57 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:05:57 user devstack@n-api.service[61613]: X-User-Id: 9bb00927681348c08cabf5cea1edaac2 Apr 19 14:05:57 user devstack@n-api.service[61613]: X-User-Name: tempest-ServersNegativeTestJSON-1629002614-project-member Apr 19 14:05:57 user devstack@n-api.service[61613]: method: > Apr 19 14:05:57 user devstack@n-api.service[61613]: exception: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:05:57 user devstack@n-api.service[61613]: action_args: {'id': '478b7934-6a66-4630-b756-521846ab8230'} Apr 19 14:05:57 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. Apr 19 14:05:57 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:57 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Returning 404 to user: Instance 478b7934-6a66-4630-b756-521846ab8230 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:57 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-ace1c8a2-092e-40b0-85a3-94f1fa6614b1 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230" status: 404 len: 111 microversion: 2.1 time: 0.028854 Apr 19 14:05:57 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 127/378] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:57 2023] GET /compute/v2.1/servers/478b7934-6a66-4630-b756-521846ab8230 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-7040df2c-8a25-483d-9689-21a0c5e38ce0 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-7040df2c-8a25-483d-9689-21a0c5e38ce0 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7040df2c-8a25-483d-9689-21a0c5e38ce0 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7040df2c-8a25-483d-9689-21a0c5e38ce0 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7040df2c-8a25-483d-9689-21a0c5e38ce0 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7040df2c-8a25-483d-9689-21a0c5e38ce0 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7040df2c-8a25-483d-9689-21a0c5e38ce0 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-7040df2c-8a25-483d-9689-21a0c5e38ce0 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:57 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-7040df2c-8a25-483d-9689-21a0c5e38ce0 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:05:57 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-7040df2c-8a25-483d-9689-21a0c5e38ce0 tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452" status: 204 len: 0 microversion: 2.1 time: 0.134560 Apr 19 14:05:57 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 127/379] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:05:57 2023] DELETE /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-3e62b578-8524-44ce-a7fd-f366891959cf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-3e62b578-8524-44ce-a7fd-f366891959cf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3e62b578-8524-44ce-a7fd-f366891959cf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3e62b578-8524-44ce-a7fd-f366891959cf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3e62b578-8524-44ce-a7fd-f366891959cf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3e62b578-8524-44ce-a7fd-f366891959cf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3e62b578-8524-44ce-a7fd-f366891959cf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:57 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-3e62b578-8524-44ce-a7fd-f366891959cf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:58 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-3e62b578-8524-44ce-a7fd-f366891959cf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb00927681348c08cabf5cea1edaac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806255a694c7446893131ff6de13c42d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-3e62b578-8524-44ce-a7fd-f366891959cf tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452" status: 200 len: 1499 microversion: 2.1 time: 0.227893 Apr 19 14:05:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 126/380] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:57 2023] GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452 => generated 1499 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-717d34ba-1c0e-45cc-818b-5abdaae30147 req-d0fe7921-0570-4540-8192-97d1409d30a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce0b5c9-a197-4697-ba7a-cba87012c452", "name": "network-vif-unplugged", "status": "completed", "tag": "07fb6250-2dfa-4106-889e-7601e4bdd4a3"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-717d34ba-1c0e-45cc-818b-5abdaae30147 req-d0fe7921-0570-4540-8192-97d1409d30a6 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-717d34ba-1c0e-45cc-818b-5abdaae30147 req-d0fe7921-0570-4540-8192-97d1409d30a6 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-717d34ba-1c0e-45cc-818b-5abdaae30147 req-d0fe7921-0570-4540-8192-97d1409d30a6 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-717d34ba-1c0e-45cc-818b-5abdaae30147 req-d0fe7921-0570-4540-8192-97d1409d30a6 service nova] Creating event network-vif-unplugged:07fb6250-2dfa-4106-889e-7601e4bdd4a3 for instance dce0b5c9-a197-4697-ba7a-cba87012c452 on user Apr 19 14:05:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-717d34ba-1c0e-45cc-818b-5abdaae30147 req-d0fe7921-0570-4540-8192-97d1409d30a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046878 Apr 19 14:05:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 128/381] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:58 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] [instance: b4c5fa56-fcc2-4b59-a1ee-0c352d92c001] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:58 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] HTTP exception thrown: Instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 could not be found. Apr 19 14:05:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Request method failure captured: Apr 19 14:05:58 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 HTTP/1.1 Apr 19 14:05:58 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:05:58 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:05:58 user devstack@n-api.service[61611]: Connection: close Apr 19 14:05:58 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:05:58 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:05:58 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:05:58 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:05:58 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_SZ8H0xzpGo65Oe4SMzFIKS3-g_LSNavSjKQPBvrG5WNvdOEDmREXWuQHShaHQH8FIu_Ot90Po5F-A6ybtbSuNEYu3hLARdcPdViHqsSZOaL5SP9cfzUyKoLA8ld64zYiDpaSZENhvcuR5TMXvs6LPGRcRvi9r2J2kd4CNJbj1B35o Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Project-Id: cb7a8a4c01784fab8210d3e9d59dbff2 Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1674858284 Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb7a8a4c01784fab8210d3e9d59dbff2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb7a8a4c01784fab8210d3e9d59dbff2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb7a8a4c01784fab8210d3e9d59dbff2"}]}] Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Tenant: tempest-SnapshotDataIntegrityTests-1674858284 Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Tenant-Id: cb7a8a4c01784fab8210d3e9d59dbff2 Apr 19 14:05:58 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1674858284 Apr 19 14:05:58 user devstack@n-api.service[61611]: X-User: tempest-SnapshotDataIntegrityTests-1674858284-project-member Apr 19 14:05:58 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:05:58 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:05:58 user devstack@n-api.service[61611]: X-User-Id: c6bbfee1957e48c2a9c4975e753ba09f Apr 19 14:05:58 user devstack@n-api.service[61611]: X-User-Name: tempest-SnapshotDataIntegrityTests-1674858284-project-member Apr 19 14:05:58 user devstack@n-api.service[61611]: method: > Apr 19 14:05:58 user devstack@n-api.service[61611]: exception: Instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 could not be found. Apr 19 14:05:58 user devstack@n-api.service[61611]: action_args: {'id': 'b4c5fa56-fcc2-4b59-a1ee-0c352d92c001'} Apr 19 14:05:58 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 could not be found. Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 could not be found. Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 could not be found. Apr 19 14:05:58 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:05:58 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Returning 404 to user: Instance b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:58 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-8af6368d-c1d9-45d0-a634-4b15b568b300 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001" status: 404 len: 111 microversion: 2.1 time: 0.032187 Apr 19 14:05:58 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 128/382] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:05:58 2023] GET /compute/v2.1/servers/b4c5fa56-fcc2-4b59-a1ee-0c352d92c001 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:05:58 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e7ad7e91-df49-47c8-8386-b9b0adce1e32 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] Calling method '.version_select at 0x7f60de256950>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:58 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e7ad7e91-df49-47c8-8386-b9b0adce1e32 tempest-SnapshotDataIntegrityTests-1674858284 tempest-SnapshotDataIntegrityTests-1674858284-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1106689667" status: 202 len: 0 microversion: 2.1 time: 0.025810 Apr 19 14:05:58 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 127/383] 10.0.0.210 () {62 vars in 1355 bytes} [Wed Apr 19 14:05:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1106689667 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 547f7955-94c5-48e4-8705-456f5d4c2d99] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] HTTP exception thrown: Instance 547f7955-94c5-48e4-8705-456f5d4c2d99 could not be found. Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Request method failure captured: Apr 19 14:05:58 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99 HTTP/1.1 Apr 19 14:05:58 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:05:58 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:05:58 user devstack@n-api.service[61613]: Connection: close Apr 19 14:05:58 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:05:58 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:05:58 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:05:58 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:05:58 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_NH9TxQ-AlgSG8fcsUjQ3kA9xtDSUjM-NMnFsny7ZG-UVjg-B4v1X-HPHooMNSE0t31PxlO2nZ6Qq6_el7ctQwVs6UlFW86AWP38_Jo3ktdXabUQhXzf_zJZOVF1kBfJ-TMSGj52EIcIIyMtwaF1ZZdkE7_Tm4b0i6OMGMnX2NgxCM Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Project-Id: 2bf567425cb7480e93f114268dc22713 Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bf567425cb7480e93f114268dc22713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bf567425cb7480e93f114268dc22713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2bf567425cb7480e93f114268dc22713"}]}] Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Tenant-Id: 2bf567425cb7480e93f114268dc22713 Apr 19 14:05:58 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:05:58 user devstack@n-api.service[61613]: X-User: tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member Apr 19 14:05:58 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:05:58 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:05:58 user devstack@n-api.service[61613]: X-User-Id: 46f11c11cc4f46e3810f06e974a387c8 Apr 19 14:05:58 user devstack@n-api.service[61613]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member Apr 19 14:05:58 user devstack@n-api.service[61613]: method: > Apr 19 14:05:58 user devstack@n-api.service[61613]: exception: Instance 547f7955-94c5-48e4-8705-456f5d4c2d99 could not be found. Apr 19 14:05:58 user devstack@n-api.service[61613]: action_args: {'id': '547f7955-94c5-48e4-8705-456f5d4c2d99'} Apr 19 14:05:58 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547f7955-94c5-48e4-8705-456f5d4c2d99 could not be found. Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547f7955-94c5-48e4-8705-456f5d4c2d99 could not be found. Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547f7955-94c5-48e4-8705-456f5d4c2d99 could not be found. Apr 19 14:05:58 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:05:58 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Returning 404 to user: Instance 547f7955-94c5-48e4-8705-456f5d4c2d99 could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:05:58 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-05aed689-7824-4ba6-bc33-d6732604b4ad tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99" status: 404 len: 111 microversion: 2.87 time: 0.027477 Apr 19 14:05:58 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 129/384] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:05:58 2023] GET /compute/v2.1/servers/547f7955-94c5-48e4-8705-456f5d4c2d99 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:05:59 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-1fcf0720-705c-4d14-8f03-ea736e5e2e30 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:59 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-1fcf0720-705c-4d14-8f03-ea736e5e2e30 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 7dd44282-31f1-44b8-a8a4-9c7556736201] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fcf0720-705c-4d14-8f03-ea736e5e2e30 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fcf0720-705c-4d14-8f03-ea736e5e2e30 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fcf0720-705c-4d14-8f03-ea736e5e2e30 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fcf0720-705c-4d14-8f03-ea736e5e2e30 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fcf0720-705c-4d14-8f03-ea736e5e2e30 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:59 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-1fcf0720-705c-4d14-8f03-ea736e5e2e30 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:59 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-1fcf0720-705c-4d14-8f03-ea736e5e2e30 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 7dd44282-31f1-44b8-a8a4-9c7556736201] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:05:59 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-65e4112b-a814-42ee-81dd-b5e687048166 req-cbce54dd-76c1-4c3b-804e-5e407ce00f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea34ad1-a903-42ca-8fb4-9d3662c2e4fd", "name": "network-vif-plugged", "status": "completed", "tag": "6a5ddb40-85bc-4e2e-bdd4-bdad086c650c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:05:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-65e4112b-a814-42ee-81dd-b5e687048166 req-cbce54dd-76c1-4c3b-804e-5e407ce00f16 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-65e4112b-a814-42ee-81dd-b5e687048166 req-cbce54dd-76c1-4c3b-804e-5e407ce00f16 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:59 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-65e4112b-a814-42ee-81dd-b5e687048166 req-cbce54dd-76c1-4c3b-804e-5e407ce00f16 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:59 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-1fcf0720-705c-4d14-8f03-ea736e5e2e30 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201" status: 204 len: 0 microversion: 2.87 time: 0.177552 Apr 19 14:05:59 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 129/385] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 14:05:59 2023] DELETE /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 14:05:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-65e4112b-a814-42ee-81dd-b5e687048166 req-cbce54dd-76c1-4c3b-804e-5e407ce00f16 service nova] Creating event network-vif-plugged:6a5ddb40-85bc-4e2e-bdd4-bdad086c650c for instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd on user Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 7dd44282-31f1-44b8-a8a4-9c7556736201] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:05:59 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-65e4112b-a814-42ee-81dd-b5e687048166 req-cbce54dd-76c1-4c3b-804e-5e407ce00f16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036196 Apr 19 14:05:59 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 128/386] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:05:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:59 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46f11c11cc4f46e3810f06e974a387c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf567425cb7480e93f114268dc22713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:05:59 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-9be4247f-7649-478a-a78d-edf9f3bc741e tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201" status: 200 len: 1695 microversion: 2.87 time: 0.326407 Apr 19 14:05:59 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 130/387] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:05:59 2023] GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201 => generated 1695 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 14:06:00 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-80e4a739-004f-48ef-bf28-0865f5740e71 req-acc0fcfb-88f4-4bb0-b5c0-6e3fff28993b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce0b5c9-a197-4697-ba7a-cba87012c452", "name": "network-vif-plugged", "status": "completed", "tag": "07fb6250-2dfa-4106-889e-7601e4bdd4a3"}, {"server_uuid": "dce0b5c9-a197-4697-ba7a-cba87012c452", "name": "network-vif-deleted", "tag": "07fb6250-2dfa-4106-889e-7601e4bdd4a3"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:06:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-80e4a739-004f-48ef-bf28-0865f5740e71 req-acc0fcfb-88f4-4bb0-b5c0-6e3fff28993b service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-80e4a739-004f-48ef-bf28-0865f5740e71 req-acc0fcfb-88f4-4bb0-b5c0-6e3fff28993b service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:00 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-80e4a739-004f-48ef-bf28-0865f5740e71 req-acc0fcfb-88f4-4bb0-b5c0-6e3fff28993b service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:00 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-80e4a739-004f-48ef-bf28-0865f5740e71 req-acc0fcfb-88f4-4bb0-b5c0-6e3fff28993b service nova] Creating event network-vif-plugged:07fb6250-2dfa-4106-889e-7601e4bdd4a3 for instance dce0b5c9-a197-4697-ba7a-cba87012c452 on user Apr 19 14:06:00 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-80e4a739-004f-48ef-bf28-0865f5740e71 req-acc0fcfb-88f4-4bb0-b5c0-6e3fff28993b service nova] Creating event network-vif-deleted:07fb6250-2dfa-4106-889e-7601e4bdd4a3 for instance dce0b5c9-a197-4697-ba7a-cba87012c452 on user Apr 19 14:06:00 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-80e4a739-004f-48ef-bf28-0865f5740e71 req-acc0fcfb-88f4-4bb0-b5c0-6e3fff28993b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043685 Apr 19 14:06:00 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 130/388] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:06:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:06:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-b3675501-4b45-47f2-b732-6b7d324a6d81 req-37b41bb8-a074-4860-9623-092722719586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd44282-31f1-44b8-a8a4-9c7556736201", "name": "network-vif-unplugged", "status": "completed", "tag": "df9c278d-65ca-4d17-aa68-89dde294a441"}, {"server_uuid": "7dd44282-31f1-44b8-a8a4-9c7556736201", "name": "network-vif-plugged", "status": "completed", "tag": "df9c278d-65ca-4d17-aa68-89dde294a441"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:06:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b3675501-4b45-47f2-b732-6b7d324a6d81 req-37b41bb8-a074-4860-9623-092722719586 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b3675501-4b45-47f2-b732-6b7d324a6d81 req-37b41bb8-a074-4860-9623-092722719586 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:01 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-b3675501-4b45-47f2-b732-6b7d324a6d81 req-37b41bb8-a074-4860-9623-092722719586 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b3675501-4b45-47f2-b732-6b7d324a6d81 req-37b41bb8-a074-4860-9623-092722719586 service nova] Creating event network-vif-unplugged:df9c278d-65ca-4d17-aa68-89dde294a441 for instance 7dd44282-31f1-44b8-a8a4-9c7556736201 on user Apr 19 14:06:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-b3675501-4b45-47f2-b732-6b7d324a6d81 req-37b41bb8-a074-4860-9623-092722719586 service nova] Creating event network-vif-plugged:df9c278d-65ca-4d17-aa68-89dde294a441 for instance 7dd44282-31f1-44b8-a8a4-9c7556736201 on user Apr 19 14:06:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-b3675501-4b45-47f2-b732-6b7d324a6d81 req-37b41bb8-a074-4860-9623-092722719586 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.042672 Apr 19 14:06:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 129/389] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:06:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-cbfa692b-6719-4b3b-b61f-535d1ebb6561 req-3ee5bd6a-1c34-4c43-85d6-81c3e27276d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd44282-31f1-44b8-a8a4-9c7556736201", "name": "network-vif-deleted", "tag": "df9c278d-65ca-4d17-aa68-89dde294a441"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:06:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cbfa692b-6719-4b3b-b61f-535d1ebb6561 req-3ee5bd6a-1c34-4c43-85d6-81c3e27276d8 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cbfa692b-6719-4b3b-b61f-535d1ebb6561 req-3ee5bd6a-1c34-4c43-85d6-81c3e27276d8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-cbfa692b-6719-4b3b-b61f-535d1ebb6561 req-3ee5bd6a-1c34-4c43-85d6-81c3e27276d8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-cbfa692b-6719-4b3b-b61f-535d1ebb6561 req-3ee5bd6a-1c34-4c43-85d6-81c3e27276d8 service nova] Creating event network-vif-deleted:df9c278d-65ca-4d17-aa68-89dde294a441 for instance 7dd44282-31f1-44b8-a8a4-9c7556736201 on user Apr 19 14:06:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-cbfa692b-6719-4b3b-b61f-535d1ebb6561 req-3ee5bd6a-1c34-4c43-85d6-81c3e27276d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028741 Apr 19 14:06:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 131/390] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:06:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-0b5de1ed-57c6-4592-b098-303599713cf2 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-0b5de1ed-57c6-4592-b098-303599713cf2 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0b5de1ed-57c6-4592-b098-303599713cf2 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0b5de1ed-57c6-4592-b098-303599713cf2 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0b5de1ed-57c6-4592-b098-303599713cf2 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0b5de1ed-57c6-4592-b098-303599713cf2 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0b5de1ed-57c6-4592-b098-303599713cf2 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-0b5de1ed-57c6-4592-b098-303599713cf2 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:18 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-0b5de1ed-57c6-4592-b098-303599713cf2 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:06:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-0b5de1ed-57c6-4592-b098-303599713cf2 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.265166 Apr 19 14:06:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 131/391] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:06:18 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=12 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] [instance: 7c628cf8-58bb-4a59-adc0-929a7ead5e00] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] HTTP exception thrown: Instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 could not be found. Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Request method failure captured: Apr 19 14:06:29 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00 HTTP/1.1 Apr 19 14:06:29 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:06:29 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:06:29 user devstack@n-api.service[61612]: Connection: close Apr 19 14:06:29 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:06:29 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:06:29 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:06:29 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:06:29 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_Ph8ml_Ca3BBEnokFWpuOEH9JoMw3L0hOcdOU3cbvpKPRkoI2MIM55371avBRnmrgkKDwo-lFl3LrGHT9uj33t5p8Vzm9dPBIbtYxkAF44gNBwbo4UeUumonR4IyamJdXqktOvDVOX46Cmzm3uk8bm0H5cPfwJGnDRNBdfMM3lTn0k Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Project-Id: 6d563f8793494ae697180a5f58c11758 Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2046718136 Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d563f8793494ae697180a5f58c11758"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d563f8793494ae697180a5f58c11758"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d563f8793494ae697180a5f58c11758"}]}] Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2046718136 Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Tenant-Id: 6d563f8793494ae697180a5f58c11758 Apr 19 14:06:29 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2046718136 Apr 19 14:06:29 user devstack@n-api.service[61612]: X-User: tempest-ServerRescueNegativeTestJSON-2046718136-project-member Apr 19 14:06:29 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:06:29 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:06:29 user devstack@n-api.service[61612]: X-User-Id: b82a409207a14dbd96308936b12a65fa Apr 19 14:06:29 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2046718136-project-member Apr 19 14:06:29 user devstack@n-api.service[61612]: method: > Apr 19 14:06:29 user devstack@n-api.service[61612]: exception: Instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 could not be found. Apr 19 14:06:29 user devstack@n-api.service[61612]: action_args: {'id': '7c628cf8-58bb-4a59-adc0-929a7ead5e00'} Apr 19 14:06:29 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 could not be found. Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 could not be found. Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 could not be found. Apr 19 14:06:29 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:06:29 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] Returning 404 to user: Instance 7c628cf8-58bb-4a59-adc0-929a7ead5e00 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:06:29 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-dbfec41e-6307-4411-9ddc-e98ffcae77cf tempest-ServerRescueNegativeTestJSON-2046718136 tempest-ServerRescueNegativeTestJSON-2046718136-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00" status: 404 len: 111 microversion: 2.1 time: 0.037519 Apr 19 14:06:29 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 130/392] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:06:29 2023] GET /compute/v2.1/servers/7c628cf8-58bb-4a59-adc0-929a7ead5e00 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=14 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=16 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-19707329-c40f-40de-86f0-8830508c172a tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-19707329-c40f-40de-86f0-8830508c172a tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] [instance: eea34ad1-a903-42ca-8fb4-9d3662c2e4fd] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-19707329-c40f-40de-86f0-8830508c172a tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-19707329-c40f-40de-86f0-8830508c172a tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-19707329-c40f-40de-86f0-8830508c172a tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-19707329-c40f-40de-86f0-8830508c172a tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-19707329-c40f-40de-86f0-8830508c172a tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-19707329-c40f-40de-86f0-8830508c172a tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:42 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-19707329-c40f-40de-86f0-8830508c172a tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef68344e8c354b0d9a826ebb6587174b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df547379af574462b674110f513ecf8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:06:42 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-19707329-c40f-40de-86f0-8830508c172a tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd" status: 200 len: 1485 microversion: 2.1 time: 0.224839 Apr 19 14:06:42 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 132/393] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:06:42 2023] GET /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd => generated 1485 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] [instance: dce0b5c9-a197-4697-ba7a-cba87012c452] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] HTTP exception thrown: Instance dce0b5c9-a197-4697-ba7a-cba87012c452 could not be found. Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Request method failure captured: Apr 19 14:06:48 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452 HTTP/1.1 Apr 19 14:06:48 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:06:48 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:06:48 user devstack@n-api.service[61611]: Connection: close Apr 19 14:06:48 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:06:48 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:06:48 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:06:48 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:06:48 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_M-dOEQ-4NBT4IixUWMW4Q_XRKqMM1rQypK-oJsBSGH_M8decPNRw1YBaLt4cA8hzjFi4aNWA1mhw2-7Z2rDyVY1sf25VgCwFUxteYsW3trJwQMPTJ0NH1k1V6laIhblLnZ9wF3iIRLgwGQ2pouoQxVqo2XyZSFWjW3Cn8ig0RBy-s Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Project-Id: 806255a694c7446893131ff6de13c42d Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/806255a694c7446893131ff6de13c42d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/806255a694c7446893131ff6de13c42d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/806255a694c7446893131ff6de13c42d"}]}] Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Tenant: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Tenant-Id: 806255a694c7446893131ff6de13c42d Apr 19 14:06:48 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1629002614 Apr 19 14:06:48 user devstack@n-api.service[61611]: X-User: tempest-ServersNegativeTestJSON-1629002614-project-member Apr 19 14:06:48 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:06:48 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:06:48 user devstack@n-api.service[61611]: X-User-Id: 9bb00927681348c08cabf5cea1edaac2 Apr 19 14:06:48 user devstack@n-api.service[61611]: X-User-Name: tempest-ServersNegativeTestJSON-1629002614-project-member Apr 19 14:06:48 user devstack@n-api.service[61611]: method: > Apr 19 14:06:48 user devstack@n-api.service[61611]: exception: Instance dce0b5c9-a197-4697-ba7a-cba87012c452 could not be found. Apr 19 14:06:48 user devstack@n-api.service[61611]: action_args: {'id': 'dce0b5c9-a197-4697-ba7a-cba87012c452'} Apr 19 14:06:48 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce0b5c9-a197-4697-ba7a-cba87012c452 could not be found. Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce0b5c9-a197-4697-ba7a-cba87012c452 could not be found. Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce0b5c9-a197-4697-ba7a-cba87012c452 could not be found. Apr 19 14:06:48 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:06:48 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] Returning 404 to user: Instance dce0b5c9-a197-4697-ba7a-cba87012c452 could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:06:48 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ca3c9ffd-0354-42db-a0df-b191315dba2f tempest-ServersNegativeTestJSON-1629002614 tempest-ServersNegativeTestJSON-1629002614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452" status: 404 len: 111 microversion: 2.1 time: 0.030894 Apr 19 14:06:48 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 132/394] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:06:48 2023] GET /compute/v2.1/servers/dce0b5c9-a197-4697-ba7a-cba87012c452 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] [instance: 7dd44282-31f1-44b8-a8a4-9c7556736201] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:06:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] HTTP exception thrown: Instance 7dd44282-31f1-44b8-a8a4-9c7556736201 could not be found. Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Request method failure captured: Apr 19 14:06:49 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201 HTTP/1.1 Apr 19 14:06:49 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:06:49 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:06:49 user devstack@n-api.service[61612]: Connection: close Apr 19 14:06:49 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:06:49 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:06:49 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:06:49 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:06:49 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_NH9TxQ-AlgSG8fcsUjQ3kA9xtDSUjM-NMnFsny7ZG-UVjg-B4v1X-HPHooMNSE0t31PxlO2nZ6Qq6_el7ctQwVs6UlFW86AWP38_Jo3ktdXabUQhXzf_zJZOVF1kBfJ-TMSGj52EIcIIyMtwaF1ZZdkE7_Tm4b0i6OMGMnX2NgxCM Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Project-Id: 2bf567425cb7480e93f114268dc22713 Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bf567425cb7480e93f114268dc22713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bf567425cb7480e93f114268dc22713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2bf567425cb7480e93f114268dc22713"}]}] Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Tenant-Id: 2bf567425cb7480e93f114268dc22713 Apr 19 14:06:49 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669 Apr 19 14:06:49 user devstack@n-api.service[61612]: X-User: tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member Apr 19 14:06:49 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:06:49 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:06:49 user devstack@n-api.service[61612]: X-User-Id: 46f11c11cc4f46e3810f06e974a387c8 Apr 19 14:06:49 user devstack@n-api.service[61612]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member Apr 19 14:06:49 user devstack@n-api.service[61612]: method: > Apr 19 14:06:49 user devstack@n-api.service[61612]: exception: Instance 7dd44282-31f1-44b8-a8a4-9c7556736201 could not be found. Apr 19 14:06:49 user devstack@n-api.service[61612]: action_args: {'id': '7dd44282-31f1-44b8-a8a4-9c7556736201'} Apr 19 14:06:49 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd44282-31f1-44b8-a8a4-9c7556736201 could not be found. Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd44282-31f1-44b8-a8a4-9c7556736201 could not be found. Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd44282-31f1-44b8-a8a4-9c7556736201 could not be found. Apr 19 14:06:49 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:06:49 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] Returning 404 to user: Instance 7dd44282-31f1-44b8-a8a4-9c7556736201 could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:06:49 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-54a8843d-f0fb-43bb-9dac-5a8ff2688e21 tempest-ServerBootFromVolumeStableRescueTest-671354669 tempest-ServerBootFromVolumeStableRescueTest-671354669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201" status: 404 len: 111 microversion: 2.87 time: 0.034158 Apr 19 14:06:49 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 131/395] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 14:06:49 2023] GET /compute/v2.1/servers/7dd44282-31f1-44b8-a8a4-9c7556736201 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 14:07:18 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-677d2a71-11c0-4394-899f-469f75e8e2cf tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:07:18 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-677d2a71-11c0-4394-899f-469f75e8e2cf tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:07:18 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:18 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-677d2a71-11c0-4394-899f-469f75e8e2cf tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-677d2a71-11c0-4394-899f-469f75e8e2cf tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-677d2a71-11c0-4394-899f-469f75e8e2cf tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-677d2a71-11c0-4394-899f-469f75e8e2cf tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-677d2a71-11c0-4394-899f-469f75e8e2cf tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:18 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-677d2a71-11c0-4394-899f-469f75e8e2cf tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:19 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-677d2a71-11c0-4394-899f-469f75e8e2cf tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:07:19 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-677d2a71-11c0-4394-899f-469f75e8e2cf tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.387998 Apr 19 14:07:19 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 133/396] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:07:18 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-74666a6e-9b2c-43ea-bc42-d369d9a4efdb tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-74666a6e-9b2c-43ea-bc42-d369d9a4efdb tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-74666a6e-9b2c-43ea-bc42-d369d9a4efdb tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-74666a6e-9b2c-43ea-bc42-d369d9a4efdb tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-74666a6e-9b2c-43ea-bc42-d369d9a4efdb tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-74666a6e-9b2c-43ea-bc42-d369d9a4efdb tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-74666a6e-9b2c-43ea-bc42-d369d9a4efdb tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-74666a6e-9b2c-43ea-bc42-d369d9a4efdb tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:19 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-74666a6e-9b2c-43ea-bc42-d369d9a4efdb tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:07:19 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-74666a6e-9b2c-43ea-bc42-d369d9a4efdb tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.313082 Apr 19 14:07:19 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 133/397] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:07:19 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-b5a951d1-1102-493a-aa89-6fa810931ae1 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-b5a951d1-1102-493a-aa89-6fa810931ae1 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b5a951d1-1102-493a-aa89-6fa810931ae1 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b5a951d1-1102-493a-aa89-6fa810931ae1 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b5a951d1-1102-493a-aa89-6fa810931ae1 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b5a951d1-1102-493a-aa89-6fa810931ae1 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b5a951d1-1102-493a-aa89-6fa810931ae1 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-b5a951d1-1102-493a-aa89-6fa810931ae1 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:19 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-b5a951d1-1102-493a-aa89-6fa810931ae1 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:07:19 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-b5a951d1-1102-493a-aa89-6fa810931ae1 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.191813 Apr 19 14:07:19 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 132/398] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:07:19 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-561288bf-fd94-470e-8dba-9e2903cbcd49 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-561288bf-fd94-470e-8dba-9e2903cbcd49 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] [instance: eea34ad1-a903-42ca-8fb4-9d3662c2e4fd] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-561288bf-fd94-470e-8dba-9e2903cbcd49 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-561288bf-fd94-470e-8dba-9e2903cbcd49 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-561288bf-fd94-470e-8dba-9e2903cbcd49 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-561288bf-fd94-470e-8dba-9e2903cbcd49 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-561288bf-fd94-470e-8dba-9e2903cbcd49 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-561288bf-fd94-470e-8dba-9e2903cbcd49 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:44 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-561288bf-fd94-470e-8dba-9e2903cbcd49 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] [instance: eea34ad1-a903-42ca-8fb4-9d3662c2e4fd] Going to try to terminate instance {{(pid=61613) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:07:44 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-561288bf-fd94-470e-8dba-9e2903cbcd49 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd" status: 204 len: 0 microversion: 2.1 time: 0.116495 Apr 19 14:07:44 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 134/399] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:07:44 2023] DELETE /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-150c9ec6-707d-4369-a578-76c370c42cbd tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-150c9ec6-707d-4369-a578-76c370c42cbd tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] [instance: eea34ad1-a903-42ca-8fb4-9d3662c2e4fd] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-150c9ec6-707d-4369-a578-76c370c42cbd tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-150c9ec6-707d-4369-a578-76c370c42cbd tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-150c9ec6-707d-4369-a578-76c370c42cbd tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-150c9ec6-707d-4369-a578-76c370c42cbd tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-150c9ec6-707d-4369-a578-76c370c42cbd tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-150c9ec6-707d-4369-a578-76c370c42cbd tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:44 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:44 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:07:44 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-150c9ec6-707d-4369-a578-76c370c42cbd tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef68344e8c354b0d9a826ebb6587174b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df547379af574462b674110f513ecf8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:07:44 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-150c9ec6-707d-4369-a578-76c370c42cbd tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd" status: 200 len: 1491 microversion: 2.1 time: 0.239271 Apr 19 14:07:44 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 134/400] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:07:44 2023] GET /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd => generated 1491 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:07:44 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-61e0f556-2036-487a-8b6b-33710146e09a req-c98f7d4b-33cf-450e-a09f-3f7c0d3e2c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea34ad1-a903-42ca-8fb4-9d3662c2e4fd", "name": "network-vif-unplugged", "status": "completed", "tag": "6a5ddb40-85bc-4e2e-bdd4-bdad086c650c"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:07:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-61e0f556-2036-487a-8b6b-33710146e09a req-c98f7d4b-33cf-450e-a09f-3f7c0d3e2c58 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-61e0f556-2036-487a-8b6b-33710146e09a req-c98f7d4b-33cf-450e-a09f-3f7c0d3e2c58 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:44 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-61e0f556-2036-487a-8b6b-33710146e09a req-c98f7d4b-33cf-450e-a09f-3f7c0d3e2c58 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:44 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-61e0f556-2036-487a-8b6b-33710146e09a req-c98f7d4b-33cf-450e-a09f-3f7c0d3e2c58 service nova] Creating event network-vif-unplugged:6a5ddb40-85bc-4e2e-bdd4-bdad086c650c for instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd on user Apr 19 14:07:45 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-61e0f556-2036-487a-8b6b-33710146e09a req-c98f7d4b-33cf-450e-a09f-3f7c0d3e2c58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087650 Apr 19 14:07:45 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 133/401] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:07:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:07:45 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-273bf2e2-2c89-424a-9623-47fd223fbb8f req-0a78581d-d48c-4747-9b02-69a75ecde34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea34ad1-a903-42ca-8fb4-9d3662c2e4fd", "name": "network-vif-deleted", "tag": "6a5ddb40-85bc-4e2e-bdd4-bdad086c650c"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:07:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-273bf2e2-2c89-424a-9623-47fd223fbb8f req-0a78581d-d48c-4747-9b02-69a75ecde34c service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-273bf2e2-2c89-424a-9623-47fd223fbb8f req-0a78581d-d48c-4747-9b02-69a75ecde34c service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:45 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-273bf2e2-2c89-424a-9623-47fd223fbb8f req-0a78581d-d48c-4747-9b02-69a75ecde34c service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-273bf2e2-2c89-424a-9623-47fd223fbb8f req-0a78581d-d48c-4747-9b02-69a75ecde34c service nova] Creating event network-vif-deleted:6a5ddb40-85bc-4e2e-bdd4-bdad086c650c for instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd on user Apr 19 14:07:45 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-273bf2e2-2c89-424a-9623-47fd223fbb8f req-0a78581d-d48c-4747-9b02-69a75ecde34c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094156 Apr 19 14:07:45 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 135/402] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:07:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:07:47 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-e87804df-440e-43f5-9155-54b3b1063f01 req-1d90c204-3c42-4696-a79d-91725a91c919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea34ad1-a903-42ca-8fb4-9d3662c2e4fd", "name": "network-vif-plugged", "status": "completed", "tag": "6a5ddb40-85bc-4e2e-bdd4-bdad086c650c"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:07:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e87804df-440e-43f5-9155-54b3b1063f01 req-1d90c204-3c42-4696-a79d-91725a91c919 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:07:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e87804df-440e-43f5-9155-54b3b1063f01 req-1d90c204-3c42-4696-a79d-91725a91c919 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:07:47 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-e87804df-440e-43f5-9155-54b3b1063f01 req-1d90c204-3c42-4696-a79d-91725a91c919 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:07:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-e87804df-440e-43f5-9155-54b3b1063f01 req-1d90c204-3c42-4696-a79d-91725a91c919 service nova] Creating event network-vif-plugged:6a5ddb40-85bc-4e2e-bdd4-bdad086c650c for instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd on user Apr 19 14:07:47 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-e87804df-440e-43f5-9155-54b3b1063f01 req-1d90c204-3c42-4696-a79d-91725a91c919 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028285 Apr 19 14:07:47 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 135/403] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:07:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-d7f8270b-2f53-4f6e-9dff-b329f91d940f tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-d7f8270b-2f53-4f6e-9dff-b329f91d940f tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7f8270b-2f53-4f6e-9dff-b329f91d940f tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7f8270b-2f53-4f6e-9dff-b329f91d940f tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7f8270b-2f53-4f6e-9dff-b329f91d940f tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7f8270b-2f53-4f6e-9dff-b329f91d940f tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7f8270b-2f53-4f6e-9dff-b329f91d940f tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-d7f8270b-2f53-4f6e-9dff-b329f91d940f tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:08:21 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-d7f8270b-2f53-4f6e-9dff-b329f91d940f tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:08:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-d7f8270b-2f53-4f6e-9dff-b329f91d940f tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.250728 Apr 19 14:08:21 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 134/404] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:08:21 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] [instance: eea34ad1-a903-42ca-8fb4-9d3662c2e4fd] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:08:34 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] HTTP exception thrown: Instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd could not be found. Apr 19 14:08:34 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Request method failure captured: Apr 19 14:08:34 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd HTTP/1.1 Apr 19 14:08:34 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:08:34 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:08:34 user devstack@n-api.service[61613]: Connection: close Apr 19 14:08:34 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:08:34 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:08:34 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:08:34 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:08:34 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_U-YCkkeUu_7YFyZSh4hwjMqc1LYQ6W0bxGQGqNp2aLpm_EAJcWwAT18TP5ngXRJIMG4GWKWigvuH5FT3ily3dMfoiMqFKWlNE8VM1OJcWxueOv35qu8lIET_QgA7xrSvs0zo5W14Fb29Y3RyYT5vU_OJlyWHxMKXxK4WtL3lXql6I Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Project-Id: df547379af574462b674110f513ecf8f Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Project-Name: tempest-VolumesActionsTest-1466767104 Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df547379af574462b674110f513ecf8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df547379af574462b674110f513ecf8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df547379af574462b674110f513ecf8f"}]}] Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Tenant: tempest-VolumesActionsTest-1466767104 Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Tenant-Id: df547379af574462b674110f513ecf8f Apr 19 14:08:34 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-VolumesActionsTest-1466767104 Apr 19 14:08:34 user devstack@n-api.service[61613]: X-User: tempest-VolumesActionsTest-1466767104-project-member Apr 19 14:08:34 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:08:34 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:08:34 user devstack@n-api.service[61613]: X-User-Id: ef68344e8c354b0d9a826ebb6587174b Apr 19 14:08:34 user devstack@n-api.service[61613]: X-User-Name: tempest-VolumesActionsTest-1466767104-project-member Apr 19 14:08:34 user devstack@n-api.service[61613]: method: > Apr 19 14:08:34 user devstack@n-api.service[61613]: exception: Instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd could not be found. Apr 19 14:08:34 user devstack@n-api.service[61613]: action_args: {'id': 'eea34ad1-a903-42ca-8fb4-9d3662c2e4fd'} Apr 19 14:08:34 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd could not be found. Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:08:34 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd could not be found. Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd could not be found. Apr 19 14:08:35 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:08:35 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] Returning 404 to user: Instance eea34ad1-a903-42ca-8fb4-9d3662c2e4fd could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:08:35 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-ce3e3c00-fa80-4662-8317-92424d824097 tempest-VolumesActionsTest-1466767104 tempest-VolumesActionsTest-1466767104-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd" status: 404 len: 111 microversion: 2.1 time: 0.037144 Apr 19 14:08:35 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 136/405] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:08:34 2023] GET /compute/v2.1/servers/eea34ad1-a903-42ca-8fb4-9d3662c2e4fd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-10a483b3-db17-4789-b783-fba242a6b0e5 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-10a483b3-db17-4789-b783-fba242a6b0e5 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-10a483b3-db17-4789-b783-fba242a6b0e5 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-10a483b3-db17-4789-b783-fba242a6b0e5 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-10a483b3-db17-4789-b783-fba242a6b0e5 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-10a483b3-db17-4789-b783-fba242a6b0e5 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-10a483b3-db17-4789-b783-fba242a6b0e5 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-10a483b3-db17-4789-b783-fba242a6b0e5 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:09:21 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-10a483b3-db17-4789-b783-fba242a6b0e5 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:09:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-10a483b3-db17-4789-b783-fba242a6b0e5 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.230124 Apr 19 14:09:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 136/406] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:09:21 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:09:21 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:09:21 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:09:21 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c233ce5d-ca3f-4ac4-8994-554fa7d90e85 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:09:21 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c233ce5d-ca3f-4ac4-8994-554fa7d90e85 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:09:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c233ce5d-ca3f-4ac4-8994-554fa7d90e85 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:09:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c233ce5d-ca3f-4ac4-8994-554fa7d90e85 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:09:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c233ce5d-ca3f-4ac4-8994-554fa7d90e85 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:09:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c233ce5d-ca3f-4ac4-8994-554fa7d90e85 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:09:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c233ce5d-ca3f-4ac4-8994-554fa7d90e85 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:09:21 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c233ce5d-ca3f-4ac4-8994-554fa7d90e85 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:09:22 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-c233ce5d-ca3f-4ac4-8994-554fa7d90e85 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:09:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c233ce5d-ca3f-4ac4-8994-554fa7d90e85 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.252000 Apr 19 14:09:22 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 135/407] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:09:21 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-6265738b-b7bd-473e-b6ae-6525b21b125a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-6265738b-b7bd-473e-b6ae-6525b21b125a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6265738b-b7bd-473e-b6ae-6525b21b125a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6265738b-b7bd-473e-b6ae-6525b21b125a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6265738b-b7bd-473e-b6ae-6525b21b125a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6265738b-b7bd-473e-b6ae-6525b21b125a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6265738b-b7bd-473e-b6ae-6525b21b125a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-6265738b-b7bd-473e-b6ae-6525b21b125a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:09:22 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-6265738b-b7bd-473e-b6ae-6525b21b125a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:09:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-6265738b-b7bd-473e-b6ae-6525b21b125a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.155169 Apr 19 14:09:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 137/408] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:09:22 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ebccc992-b54e-47c3-b737-968731771b50 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-ebccc992-b54e-47c3-b737-968731771b50 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ebccc992-b54e-47c3-b737-968731771b50 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ebccc992-b54e-47c3-b737-968731771b50 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ebccc992-b54e-47c3-b737-968731771b50 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ebccc992-b54e-47c3-b737-968731771b50 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ebccc992-b54e-47c3-b737-968731771b50 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-ebccc992-b54e-47c3-b737-968731771b50 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:10:24 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-ebccc992-b54e-47c3-b737-968731771b50 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:10:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ebccc992-b54e-47c3-b737-968731771b50 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1657 microversion: 2.1 time: 0.320117 Apr 19 14:10:24 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 137/409] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:10:24 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1657 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:11:24 user devstack@n-api.service[61612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 14:11:24 user devstack@n-api.service[61612]: Wed Apr 19 14:11:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc (ip 10.0.0.210) !!! Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-7959318b-8c01-42ec-8780-d4fb38360917 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7959318b-8c01-42ec-8780-d4fb38360917 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7959318b-8c01-42ec-8780-d4fb38360917 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7959318b-8c01-42ec-8780-d4fb38360917 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7959318b-8c01-42ec-8780-d4fb38360917 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7959318b-8c01-42ec-8780-d4fb38360917 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7959318b-8c01-42ec-8780-d4fb38360917 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-7959318b-8c01-42ec-8780-d4fb38360917 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:11:24 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-7959318b-8c01-42ec-8780-d4fb38360917 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:11:24 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-7959318b-8c01-42ec-8780-d4fb38360917 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 204 len: 0 microversion: 2.1 time: 0.156423 Apr 19 14:11:24 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 136/410] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:11:24 2023] DELETE /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:11:24 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:11:24 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:11:24 user devstack@n-api.service[61613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 14:11:24 user devstack@n-api.service[61613]: Wed Apr 19 14:11:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc (ip 10.0.0.210) !!! Apr 19 14:11:24 user devstack@n-api.service[61613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 14:11:24 user devstack@n-api.service[61613]: Wed Apr 19 14:11:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc (ip 10.0.0.210) !!! Apr 19 14:11:24 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2712de80-eda1-4225-84e2-46258a38a43a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:11:24 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2712de80-eda1-4225-84e2-46258a38a43a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:11:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2712de80-eda1-4225-84e2-46258a38a43a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:11:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2712de80-eda1-4225-84e2-46258a38a43a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:11:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2712de80-eda1-4225-84e2-46258a38a43a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:11:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2712de80-eda1-4225-84e2-46258a38a43a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:11:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2712de80-eda1-4225-84e2-46258a38a43a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:11:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2712de80-eda1-4225-84e2-46258a38a43a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:11:25 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:11:25 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:11:25 user devstack@n-api.service[61611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 14:11:25 user devstack@n-api.service[61611]: Wed Apr 19 14:11:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 19 14:11:25 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-1c73f016-7ef7-486d-a980-46455e767745 req-8b849f66-d897-4565-bd87-0d72e8fc5d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb235214-2700-4447-9dcf-517ebbf414cc", "name": "network-vif-unplugged", "status": "completed", "tag": "787ed8af-95eb-4d0f-bb41-0cbbd78d488e"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:11:25 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-2712de80-eda1-4225-84e2-46258a38a43a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b32d5735f2a4babb219b9e66d5cd4ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30547cb5530e48a0bbcadde54e832d24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:11:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1c73f016-7ef7-486d-a980-46455e767745 req-8b849f66-d897-4565-bd87-0d72e8fc5d16 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:11:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1c73f016-7ef7-486d-a980-46455e767745 req-8b849f66-d897-4565-bd87-0d72e8fc5d16 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:11:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-1c73f016-7ef7-486d-a980-46455e767745 req-8b849f66-d897-4565-bd87-0d72e8fc5d16 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:11:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-1c73f016-7ef7-486d-a980-46455e767745 req-8b849f66-d897-4565-bd87-0d72e8fc5d16 service nova] Creating event network-vif-unplugged:787ed8af-95eb-4d0f-bb41-0cbbd78d488e for instance cb235214-2700-4447-9dcf-517ebbf414cc on user Apr 19 14:11:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2712de80-eda1-4225-84e2-46258a38a43a tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 200 len: 1663 microversion: 2.1 time: 0.302763 Apr 19 14:11:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-1c73f016-7ef7-486d-a980-46455e767745 req-8b849f66-d897-4565-bd87-0d72e8fc5d16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037640 Apr 19 14:11:25 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 138/411] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:11:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:11:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 138/412] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:11:24 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 1663 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:11:27 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-317ce81b-7db4-4f00-ac8f-784ca2a44786 req-d7c41800-4b91-40ed-9861-68dde0ac8692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb235214-2700-4447-9dcf-517ebbf414cc", "name": "network-vif-plugged", "status": "completed", "tag": "787ed8af-95eb-4d0f-bb41-0cbbd78d488e"}, {"server_uuid": "cb235214-2700-4447-9dcf-517ebbf414cc", "name": "network-vif-deleted", "tag": "787ed8af-95eb-4d0f-bb41-0cbbd78d488e"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:11:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-317ce81b-7db4-4f00-ac8f-784ca2a44786 req-d7c41800-4b91-40ed-9861-68dde0ac8692 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:11:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-317ce81b-7db4-4f00-ac8f-784ca2a44786 req-d7c41800-4b91-40ed-9861-68dde0ac8692 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:11:27 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-317ce81b-7db4-4f00-ac8f-784ca2a44786 req-d7c41800-4b91-40ed-9861-68dde0ac8692 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:11:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-317ce81b-7db4-4f00-ac8f-784ca2a44786 req-d7c41800-4b91-40ed-9861-68dde0ac8692 service nova] Creating event network-vif-plugged:787ed8af-95eb-4d0f-bb41-0cbbd78d488e for instance cb235214-2700-4447-9dcf-517ebbf414cc on user Apr 19 14:11:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-317ce81b-7db4-4f00-ac8f-784ca2a44786 req-d7c41800-4b91-40ed-9861-68dde0ac8692 service nova] Creating event network-vif-deleted:787ed8af-95eb-4d0f-bb41-0cbbd78d488e for instance cb235214-2700-4447-9dcf-517ebbf414cc on user Apr 19 14:11:27 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-317ce81b-7db4-4f00-ac8f-784ca2a44786 req-d7c41800-4b91-40ed-9861-68dde0ac8692 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030108 Apr 19 14:11:27 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 137/413] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:11:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [instance: cb235214-2700-4447-9dcf-517ebbf414cc] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:12:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] HTTP exception thrown: Instance cb235214-2700-4447-9dcf-517ebbf414cc could not be found. Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Request method failure captured: Apr 19 14:12:15 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc HTTP/1.1 Apr 19 14:12:15 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:12:15 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:12:15 user devstack@n-api.service[61611]: Connection: close Apr 19 14:12:15 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:12:15 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:12:15 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:12:15 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:12:15 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_R413PHkgtJmR3K9NBDO5z6WarbiA3V7Msddt4NYA2xXzzS1WLpBli9FPL8Rv37WG9RT9qwM1EXOcuOHbS2VDOwIubD8nF76Kd0dQkX0ejnVwbRX4F6TBvny6ZxlUvtULMAionn5kcklwIH8x7Lm2jo8D7e5JUVZ4MxrmsAc8dkYF4 Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Project-Id: 30547cb5530e48a0bbcadde54e832d24 Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Project-Name: tempest-ServerActionsTestJSON-1629725708 Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/30547cb5530e48a0bbcadde54e832d24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/30547cb5530e48a0bbcadde54e832d24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/30547cb5530e48a0bbcadde54e832d24"}]}] Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Tenant: tempest-ServerActionsTestJSON-1629725708 Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Tenant-Id: 30547cb5530e48a0bbcadde54e832d24 Apr 19 14:12:15 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-ServerActionsTestJSON-1629725708 Apr 19 14:12:15 user devstack@n-api.service[61611]: X-User: tempest-ServerActionsTestJSON-1629725708-project-member Apr 19 14:12:15 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:12:15 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:12:15 user devstack@n-api.service[61611]: X-User-Id: 9b32d5735f2a4babb219b9e66d5cd4ed Apr 19 14:12:15 user devstack@n-api.service[61611]: X-User-Name: tempest-ServerActionsTestJSON-1629725708-project-member Apr 19 14:12:15 user devstack@n-api.service[61611]: method: > Apr 19 14:12:15 user devstack@n-api.service[61611]: exception: Instance cb235214-2700-4447-9dcf-517ebbf414cc could not be found. Apr 19 14:12:15 user devstack@n-api.service[61611]: action_args: {'id': 'cb235214-2700-4447-9dcf-517ebbf414cc'} Apr 19 14:12:15 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb235214-2700-4447-9dcf-517ebbf414cc could not be found. Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb235214-2700-4447-9dcf-517ebbf414cc could not be found. Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb235214-2700-4447-9dcf-517ebbf414cc could not be found. Apr 19 14:12:15 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:12:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Returning 404 to user: Instance cb235214-2700-4447-9dcf-517ebbf414cc could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:12:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-c99ce4f1-7d27-4c92-a072-2cca025eff07 tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc" status: 404 len: 111 microversion: 2.1 time: 0.041814 Apr 19 14:12:15 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 139/414] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:12:15 2023] GET /compute/v2.1/servers/cb235214-2700-4447-9dcf-517ebbf414cc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:12:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-b64c05dd-407e-40df-8491-ca41bc01e3dc tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] Calling method '.version_select at 0x7f60de379480>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:12:15 user devstack@n-api.service[61613]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b64c05dd-407e-40df-8491-ca41bc01e3dc tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [123ccb8f-7b5c-448c-9c65-7ed358117a6c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 19 14:12:15 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:12:15 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:12:16 user devstack@n-api.service[61613]: INFO oslo.messaging._drivers.impl_rabbit [None req-b64c05dd-407e-40df-8491-ca41bc01e3dc tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] [123ccb8f-7b5c-448c-9c65-7ed358117a6c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 32990. Apr 19 14:12:16 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-b64c05dd-407e-40df-8491-ca41bc01e3dc tempest-ServerActionsTestJSON-1629725708 tempest-ServerActionsTestJSON-1629725708-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803253154" status: 202 len: 0 microversion: 2.1 time: 1.053745 Apr 19 14:12:16 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 139/415] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:12:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803253154 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:12:28 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:12:28 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:12:28 user devstack@n-api.service[61612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 14:12:28 user devstack@n-api.service[61612]: Wed Apr 19 14:12:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 19 14:12:28 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-43d9a2f3-8661-4655-aebb-fa7b5e2ebb88 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Action: 'create', calling method: .version_select at 0x7f60de256560>, body: {"keypair": {"name": "tempest-keypair-838288690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa31EDGWDcuv3HRZUiqkqZGOUa8B+6aVp5KF/h8Tehy7BmJMLoluvUuWsnY3xPN0oT/2YIpQlN+eX+1AYs6PU38H0y1EyddBTCfewOQK+AjT5UiTDmtRIZb9xQPWH/EuQ=="}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:12:28 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-43d9a2f3-8661-4655-aebb-fa7b5e2ebb88 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Getting quotas for project 27441f3068f845f7bb405083b2a447ae. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:12:28 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-43d9a2f3-8661-4655-aebb-fa7b5e2ebb88 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Getting quotas for user 3a8f62a56ad34e338cbd9f851af92966 and project 27441f3068f845f7bb405083b2a447ae. Resources: {'key_pairs'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:12:28 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-43d9a2f3-8661-4655-aebb-fa7b5e2ebb88 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182104 Apr 19 14:12:28 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 138/416] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:12:28 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:12:29 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1974543229", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d43c871f-af76-4e39-b0fc-517a46e61234"}], "security_groups": [{"name": "tempest-securitygroup--1375487"}], "key_name": "tempest-keypair-838288690", "user_data": "}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:12:29 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:12:29 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG nova.network.neutron [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] validate_networks() for [('d43c871f-af76-4e39-b0fc-517a46e61234', None, None, None, None, None)] {{(pid=61611) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Flavor limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Image limits 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Flavor pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Image pref 0:0:0 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG nova.virt.hardware [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Getting quotas for project 27441f3068f845f7bb405083b2a447ae. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG nova.quota [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Getting quotas for user 3a8f62a56ad34e338cbd9f851af92966 and project 27441f3068f845f7bb405083b2a447ae. Resources: {'ram', 'instances', 'cores'} {{(pid=61611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Going to run 1 instances... {{(pid=61611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:12:30 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:12:30 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-f15054fe-d5de-4d5d-b12f-8118f095718c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 397 microversion: 2.1 time: 0.748405 Apr 19 14:12:30 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 140/417] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:12:29 2023] POST /compute/v2.1/servers => generated 397 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:12:30 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:12:30 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-cc5d7c7d-f8e8-459d-ba6f-a5c8955b3adc tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:12:30 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-cc5d7c7d-f8e8-459d-ba6f-a5c8955b3adc tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:12:30 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-cc5d7c7d-f8e8-459d-ba6f-a5c8955b3adc tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8f62a56ad34e338cbd9f851af92966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27441f3068f845f7bb405083b2a447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:12:30 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-cc5d7c7d-f8e8-459d-ba6f-a5c8955b3adc tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a" status: 200 len: 1231 microversion: 2.1 time: 0.128608 Apr 19 14:12:30 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 140/418] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:12:30 2023] GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a => generated 1231 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:12:33 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-5bd59038-9aef-4797-bad1-501a7bf24a70 req-7ef1d48f-6db2-477e-be3e-27bb5b9919a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a", "tag": "bce8077a-2031-403d-8d99-a493955855ed"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:12:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5bd59038-9aef-4797-bad1-501a7bf24a70 req-7ef1d48f-6db2-477e-be3e-27bb5b9919a0 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:12:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5bd59038-9aef-4797-bad1-501a7bf24a70 req-7ef1d48f-6db2-477e-be3e-27bb5b9919a0 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:12:33 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-5bd59038-9aef-4797-bad1-501a7bf24a70 req-7ef1d48f-6db2-477e-be3e-27bb5b9919a0 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:12:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-5bd59038-9aef-4797-bad1-501a7bf24a70 req-7ef1d48f-6db2-477e-be3e-27bb5b9919a0 service nova] Creating event network-changed:bce8077a-2031-403d-8d99-a493955855ed for instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a on user Apr 19 14:12:33 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-5bd59038-9aef-4797-bad1-501a7bf24a70 req-7ef1d48f-6db2-477e-be3e-27bb5b9919a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033485 Apr 19 14:12:33 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 139/419] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:12:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:12:35 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-0b9f41e1-9844-4a2b-9292-78085ea55afb req-6559e2e4-d154-4dc2-bbed-b3c385b7b277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a", "name": "network-vif-plugged", "status": "completed", "tag": "bce8077a-2031-403d-8d99-a493955855ed"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:12:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b9f41e1-9844-4a2b-9292-78085ea55afb req-6559e2e4-d154-4dc2-bbed-b3c385b7b277 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:12:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b9f41e1-9844-4a2b-9292-78085ea55afb req-6559e2e4-d154-4dc2-bbed-b3c385b7b277 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:12:35 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-0b9f41e1-9844-4a2b-9292-78085ea55afb req-6559e2e4-d154-4dc2-bbed-b3c385b7b277 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:12:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-0b9f41e1-9844-4a2b-9292-78085ea55afb req-6559e2e4-d154-4dc2-bbed-b3c385b7b277 service nova] Creating event network-vif-plugged:bce8077a-2031-403d-8d99-a493955855ed for instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a on user Apr 19 14:12:35 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-0b9f41e1-9844-4a2b-9292-78085ea55afb req-6559e2e4-d154-4dc2-bbed-b3c385b7b277 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099064 Apr 19 14:12:35 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 141/420] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:12:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:12:37 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-201f34e5-5e97-4f38-8f2b-7bf91cfdf15d req-ec01160c-2943-43bc-ad7a-b780eeaa593a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a", "name": "network-vif-plugged", "status": "completed", "tag": "bce8077a-2031-403d-8d99-a493955855ed"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:12:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-201f34e5-5e97-4f38-8f2b-7bf91cfdf15d req-ec01160c-2943-43bc-ad7a-b780eeaa593a service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:12:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-201f34e5-5e97-4f38-8f2b-7bf91cfdf15d req-ec01160c-2943-43bc-ad7a-b780eeaa593a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:12:37 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-201f34e5-5e97-4f38-8f2b-7bf91cfdf15d req-ec01160c-2943-43bc-ad7a-b780eeaa593a service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:12:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-201f34e5-5e97-4f38-8f2b-7bf91cfdf15d req-ec01160c-2943-43bc-ad7a-b780eeaa593a service nova] Creating event network-vif-plugged:bce8077a-2031-403d-8d99-a493955855ed for instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a on user Apr 19 14:12:37 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-201f34e5-5e97-4f38-8f2b-7bf91cfdf15d req-ec01160c-2943-43bc-ad7a-b780eeaa593a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036249 Apr 19 14:12:37 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 141/421] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:12:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-92733921-8c88-49e4-9b2d-a1e2e131dcbf tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-92733921-8c88-49e4-9b2d-a1e2e131dcbf tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-92733921-8c88-49e4-9b2d-a1e2e131dcbf tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-92733921-8c88-49e4-9b2d-a1e2e131dcbf tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-92733921-8c88-49e4-9b2d-a1e2e131dcbf tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-92733921-8c88-49e4-9b2d-a1e2e131dcbf tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-92733921-8c88-49e4-9b2d-a1e2e131dcbf tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:13:20 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-92733921-8c88-49e4-9b2d-a1e2e131dcbf tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:13:21 user devstack@n-api.service[61612]: DEBUG nova.policy [None req-92733921-8c88-49e4-9b2d-a1e2e131dcbf tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8f62a56ad34e338cbd9f851af92966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27441f3068f845f7bb405083b2a447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61612) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:13:21 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-92733921-8c88-49e4-9b2d-a1e2e131dcbf tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a" status: 200 len: 1535 microversion: 2.1 time: 0.275540 Apr 19 14:13:21 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 140/422] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:13:20 2023] GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a => generated 1535 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=6 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-82dbffba-6695-498a-abf9-2df8f2758642 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-82dbffba-6695-498a-abf9-2df8f2758642 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-82dbffba-6695-498a-abf9-2df8f2758642 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-82dbffba-6695-498a-abf9-2df8f2758642 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-82dbffba-6695-498a-abf9-2df8f2758642 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-82dbffba-6695-498a-abf9-2df8f2758642 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-82dbffba-6695-498a-abf9-2df8f2758642 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:21 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-82dbffba-6695-498a-abf9-2df8f2758642 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:21 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-82dbffba-6695-498a-abf9-2df8f2758642 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.187016 Apr 19 14:14:21 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 142/423] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:14:21 2023] GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a/os-interface => generated 283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:14:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:14:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:14:22 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:14:22 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-abf30973-ea66-421a-9765-ed2e67852a4c req-4ac55fd0-896f-485a-a419-b143e46dffc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a", "tag": "bce8077a-2031-403d-8d99-a493955855ed"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:14:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-abf30973-ea66-421a-9765-ed2e67852a4c req-4ac55fd0-896f-485a-a419-b143e46dffc8 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-abf30973-ea66-421a-9765-ed2e67852a4c req-4ac55fd0-896f-485a-a419-b143e46dffc8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:22 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-abf30973-ea66-421a-9765-ed2e67852a4c req-4ac55fd0-896f-485a-a419-b143e46dffc8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-abf30973-ea66-421a-9765-ed2e67852a4c req-4ac55fd0-896f-485a-a419-b143e46dffc8 service nova] Creating event network-changed:bce8077a-2031-403d-8d99-a493955855ed for instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a on user Apr 19 14:14:22 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-abf30973-ea66-421a-9765-ed2e67852a4c req-4ac55fd0-896f-485a-a419-b143e46dffc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107880 Apr 19 14:14:22 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 142/424] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:14:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:14:23 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:14:23 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:14:23 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-e0b78ba5-f403-4fb6-bd51-ac4d2a758349 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:14:23 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-e0b78ba5-f403-4fb6-bd51-ac4d2a758349 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:14:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e0b78ba5-f403-4fb6-bd51-ac4d2a758349 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e0b78ba5-f403-4fb6-bd51-ac4d2a758349 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e0b78ba5-f403-4fb6-bd51-ac4d2a758349 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e0b78ba5-f403-4fb6-bd51-ac4d2a758349 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e0b78ba5-f403-4fb6-bd51-ac4d2a758349 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:23 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-e0b78ba5-f403-4fb6-bd51-ac4d2a758349 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:23 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-e0b78ba5-f403-4fb6-bd51-ac4d2a758349 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a/ips" status: 200 len: 144 microversion: 2.1 time: 0.040299 Apr 19 14:14:23 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 141/425] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:14:23 2023] GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:14:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-6d60aa92-be7b-4fa1-bf55-1240d5f21df8 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:14:24 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-6d60aa92-be7b-4fa1-bf55-1240d5f21df8 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:14:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6d60aa92-be7b-4fa1-bf55-1240d5f21df8 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6d60aa92-be7b-4fa1-bf55-1240d5f21df8 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6d60aa92-be7b-4fa1-bf55-1240d5f21df8 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6d60aa92-be7b-4fa1-bf55-1240d5f21df8 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6d60aa92-be7b-4fa1-bf55-1240d5f21df8 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:24 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-6d60aa92-be7b-4fa1-bf55-1240d5f21df8 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:24 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-6d60aa92-be7b-4fa1-bf55-1240d5f21df8 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] Going to try to terminate instance {{(pid=61611) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:14:24 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-6d60aa92-be7b-4fa1-bf55-1240d5f21df8 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a" status: 204 len: 0 microversion: 2.1 time: 0.111148 Apr 19 14:14:24 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 143/426] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:14:24 2023] DELETE /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:14:24 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-e6c2ea67-6892-410b-9b9f-5dd96fdd6f76 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:14:24 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-e6c2ea67-6892-410b-9b9f-5dd96fdd6f76 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:14:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6c2ea67-6892-410b-9b9f-5dd96fdd6f76 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6c2ea67-6892-410b-9b9f-5dd96fdd6f76 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6c2ea67-6892-410b-9b9f-5dd96fdd6f76 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6c2ea67-6892-410b-9b9f-5dd96fdd6f76 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6c2ea67-6892-410b-9b9f-5dd96fdd6f76 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:24 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-e6c2ea67-6892-410b-9b9f-5dd96fdd6f76 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:25 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-a96740d5-258b-45a6-9299-2c6a7bc11f08 req-77eb3670-9392-4091-969f-ce06ad6d79e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a", "name": "network-vif-unplugged", "status": "completed", "tag": "bce8077a-2031-403d-8d99-a493955855ed"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:14:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a96740d5-258b-45a6-9299-2c6a7bc11f08 req-77eb3670-9392-4091-969f-ce06ad6d79e9 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a96740d5-258b-45a6-9299-2c6a7bc11f08 req-77eb3670-9392-4091-969f-ce06ad6d79e9 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:25 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-a96740d5-258b-45a6-9299-2c6a7bc11f08 req-77eb3670-9392-4091-969f-ce06ad6d79e9 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:25 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-e6c2ea67-6892-410b-9b9f-5dd96fdd6f76 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8f62a56ad34e338cbd9f851af92966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27441f3068f845f7bb405083b2a447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:14:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-a96740d5-258b-45a6-9299-2c6a7bc11f08 req-77eb3670-9392-4091-969f-ce06ad6d79e9 service nova] Creating event network-vif-unplugged:bce8077a-2031-403d-8d99-a493955855ed for instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a on user Apr 19 14:14:25 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-e6c2ea67-6892-410b-9b9f-5dd96fdd6f76 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a" status: 200 len: 1659 microversion: 2.1 time: 0.348452 Apr 19 14:14:25 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 143/427] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:14:24 2023] GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a => generated 1659 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:14:25 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-a96740d5-258b-45a6-9299-2c6a7bc11f08 req-77eb3670-9392-4091-969f-ce06ad6d79e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028363 Apr 19 14:14:25 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 142/428] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:14:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 14:14:26 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-fab67929-ee21-4a14-8e20-4ba283bab3ed req-fd365fe1-31d6-4129-a9be-8d51de35056f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a", "name": "network-vif-deleted", "tag": "bce8077a-2031-403d-8d99-a493955855ed"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fab67929-ee21-4a14-8e20-4ba283bab3ed req-fd365fe1-31d6-4129-a9be-8d51de35056f service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fab67929-ee21-4a14-8e20-4ba283bab3ed req-fd365fe1-31d6-4129-a9be-8d51de35056f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:26 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-fab67929-ee21-4a14-8e20-4ba283bab3ed req-fd365fe1-31d6-4129-a9be-8d51de35056f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-fab67929-ee21-4a14-8e20-4ba283bab3ed req-fd365fe1-31d6-4129-a9be-8d51de35056f service nova] Creating event network-vif-deleted:bce8077a-2031-403d-8d99-a493955855ed for instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a on user Apr 19 14:14:26 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-fab67929-ee21-4a14-8e20-4ba283bab3ed req-fd365fe1-31d6-4129-a9be-8d51de35056f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030892 Apr 19 14:14:26 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 144/429] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:14:27 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-3c21f076-d126-49ae-ad29-593892f4d5e9 req-2f8a91a9-7963-4041-982e-08fabfe791a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a", "name": "network-vif-plugged", "status": "completed", "tag": "bce8077a-2031-403d-8d99-a493955855ed"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:14:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3c21f076-d126-49ae-ad29-593892f4d5e9 req-2f8a91a9-7963-4041-982e-08fabfe791a6 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:14:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3c21f076-d126-49ae-ad29-593892f4d5e9 req-2f8a91a9-7963-4041-982e-08fabfe791a6 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:14:27 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-3c21f076-d126-49ae-ad29-593892f4d5e9 req-2f8a91a9-7963-4041-982e-08fabfe791a6 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:14:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-3c21f076-d126-49ae-ad29-593892f4d5e9 req-2f8a91a9-7963-4041-982e-08fabfe791a6 service nova] Creating event network-vif-plugged:bce8077a-2031-403d-8d99-a493955855ed for instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a on user Apr 19 14:14:27 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-3c21f076-d126-49ae-ad29-593892f4d5e9 req-2f8a91a9-7963-4041-982e-08fabfe791a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030247 Apr 19 14:14:27 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 144/430] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:14:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=4 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:15:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] HTTP exception thrown: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Request method failure captured: Apr 19 14:15:15 user devstack@n-api.service[61612]: request: GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a HTTP/1.1 Apr 19 14:15:15 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:15:15 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:15:15 user devstack@n-api.service[61612]: Connection: close Apr 19 14:15:15 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:15:15 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:15:15 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:15:15 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:15:15 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_bMAKQjOAXyDdoF0AHNOcSdxGBTYlmz0Ke6ZjjpCI-6gzzbZ7K4O58HWAkQlmnyNYfnHpYHrsibTy-oTDYpyB--O9MIRFdha20ABcJB_UA2S-LmPqAQpC-_awoUd6JGljF0sejchraCIQjNHiVeUgDhJUgI408ZgIyQmhypAG7Ga7A Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Project-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27441f3068f845f7bb405083b2a447ae"}]}] Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Tenant-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:15:15 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:15:15 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:15:15 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:15:15 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:15:15 user devstack@n-api.service[61612]: X-User-Id: 3a8f62a56ad34e338cbd9f851af92966 Apr 19 14:15:15 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:15:15 user devstack@n-api.service[61612]: method: > Apr 19 14:15:15 user devstack@n-api.service[61612]: exception: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:15:15 user devstack@n-api.service[61612]: action_args: {'id': '6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a'} Apr 19 14:15:15 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:15:15 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:15:15 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Returning 404 to user: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:15:15 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-455634f0-72f9-4da5-b5ee-bb8d6d1aa074 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a" status: 404 len: 111 microversion: 2.1 time: 0.035942 Apr 19 14:15:15 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 143/431] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:15:15 2023] GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:15:15 user devstack@n-api.service[61611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 14:15:15 user devstack@n-api.service[61611]: Wed Apr 19 14:15:15 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-838288690 (ip 10.0.0.210) !!! Apr 19 14:15:15 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:15:15 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:15:15 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-27764d73-ad14-4ea8-823f-c7cb3b6c59fd tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '.version_select at 0x7f60de11b2e0>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:15:15 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-27764d73-ad14-4ea8-823f-c7cb3b6c59fd tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838288690" status: 202 len: 0 microversion: 2.1 time: 0.037564 Apr 19 14:15:15 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 145/432] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 14:15:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838288690 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:15:15 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:15:15 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=10 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:15:15 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-be0256d5-28a9-4b50-b784-a09158378d89 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Action: 'create', calling method: .version_select at 0x7f60de379360>, body: {"keypair": {"name": "tempest-keypair-1744154661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg3u0wd6XYvHkkTVvrvo5Ni6dk1CfCQyU+qx/hDt0Jcn+brywDHrxunyYqFfMIz54dT9w02aTIOeenXBztAjo7FV/scrsBnjlWpU/QQLZmggDKhyTLFPH1YqdsaUufFPQ=="}} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:15:15 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-be0256d5-28a9-4b50-b784-a09158378d89 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Getting quotas for project 27441f3068f845f7bb405083b2a447ae. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:15:15 user devstack@n-api.service[61613]: DEBUG nova.quota [None req-be0256d5-28a9-4b50-b784-a09158378d89 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Getting quotas for user 3a8f62a56ad34e338cbd9f851af92966 and project 27441f3068f845f7bb405083b2a447ae. Resources: {'key_pairs'} {{(pid=61613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:15:15 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-be0256d5-28a9-4b50-b784-a09158378d89 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057888 Apr 19 14:15:15 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 145/433] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 14:15:15 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:15:17 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2087372576", "imageRef": "4dcdc911-3648-46b3-8c6e-9727e5375516", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d43c871f-af76-4e39-b0fc-517a46e61234"}], "security_groups": [{"name": "tempest-securitygroup--1266840790"}], "key_name": "tempest-keypair-1744154661", "user_data": "}} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:15:17 user devstack@n-api.service[61612]: DEBUG nova.network.neutron [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] validate_networks() for [('d43c871f-af76-4e39-b0fc-517a46e61234', None, None, None, None, None)] {{(pid=61612) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Flavor limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Image limits 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Flavor pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Image pref 0:0:0 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG nova.virt.hardware [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Getting quotas for project 27441f3068f845f7bb405083b2a447ae. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG nova.quota [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Getting quotas for user 3a8f62a56ad34e338cbd9f851af92966 and project 27441f3068f845f7bb405083b2a447ae. Resources: {'ram', 'instances', 'cores'} {{(pid=61612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Going to run 1 instances... {{(pid=61612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 14:15:18 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcdc911-3648-46b3-8c6e-9727e5375516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 14:15:18 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-5e7cba53-adcb-431b-abd4-6868fe22ed74 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.739172 Apr 19 14:15:18 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 144/434] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 14:15:17 2023] POST /compute/v2.1/servers => generated 400 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 14:15:18 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-a9d14350-c00a-4dec-bf6c-e3fbca79d0de tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:15:18 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-a9d14350-c00a-4dec-bf6c-e3fbca79d0de tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:15:18 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-a9d14350-c00a-4dec-bf6c-e3fbca79d0de tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8f62a56ad34e338cbd9f851af92966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27441f3068f845f7bb405083b2a447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:15:18 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-a9d14350-c00a-4dec-bf6c-e3fbca79d0de tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd" status: 200 len: 1232 microversion: 2.1 time: 0.065410 Apr 19 14:15:18 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 146/435] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:15:18 2023] GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd => generated 1232 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:15:20 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-a9f27118-4338-4726-8a56-92a89f4c6569 req-ab18bcc4-6950-4841-9400-2a13f665b258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01cbd10-f562-4a76-8915-6c725d42dadd", "tag": "731519ce-d7d2-4e48-85ad-db7c94def87a"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:15:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a9f27118-4338-4726-8a56-92a89f4c6569 req-ab18bcc4-6950-4841-9400-2a13f665b258 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:15:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a9f27118-4338-4726-8a56-92a89f4c6569 req-ab18bcc4-6950-4841-9400-2a13f665b258 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:15:20 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-a9f27118-4338-4726-8a56-92a89f4c6569 req-ab18bcc4-6950-4841-9400-2a13f665b258 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:15:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-a9f27118-4338-4726-8a56-92a89f4c6569 req-ab18bcc4-6950-4841-9400-2a13f665b258 service nova] Creating event network-changed:731519ce-d7d2-4e48-85ad-db7c94def87a for instance d01cbd10-f562-4a76-8915-6c725d42dadd on user Apr 19 14:15:20 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-a9f27118-4338-4726-8a56-92a89f4c6569 req-ab18bcc4-6950-4841-9400-2a13f665b258 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029697 Apr 19 14:15:20 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 146/436] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:15:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:15:22 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-fe7f97f4-75c4-48bb-b893-00f3de01418c req-46e43187-d2a7-4de0-883b-88d042caf2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01cbd10-f562-4a76-8915-6c725d42dadd", "name": "network-vif-plugged", "status": "completed", "tag": "731519ce-d7d2-4e48-85ad-db7c94def87a"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:15:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-fe7f97f4-75c4-48bb-b893-00f3de01418c req-46e43187-d2a7-4de0-883b-88d042caf2a8 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:15:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-fe7f97f4-75c4-48bb-b893-00f3de01418c req-46e43187-d2a7-4de0-883b-88d042caf2a8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:15:22 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-fe7f97f4-75c4-48bb-b893-00f3de01418c req-46e43187-d2a7-4de0-883b-88d042caf2a8 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:15:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-fe7f97f4-75c4-48bb-b893-00f3de01418c req-46e43187-d2a7-4de0-883b-88d042caf2a8 service nova] Creating event network-vif-plugged:731519ce-d7d2-4e48-85ad-db7c94def87a for instance d01cbd10-f562-4a76-8915-6c725d42dadd on user Apr 19 14:15:22 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-fe7f97f4-75c4-48bb-b893-00f3de01418c req-46e43187-d2a7-4de0-883b-88d042caf2a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032362 Apr 19 14:15:22 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 145/437] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:15:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:15:24 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-d619ac96-3fff-4451-8d8a-58b9b458503f req-e64d4a6f-f59b-46b3-8ad2-af26e2000a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01cbd10-f562-4a76-8915-6c725d42dadd", "name": "network-vif-plugged", "status": "completed", "tag": "731519ce-d7d2-4e48-85ad-db7c94def87a"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:15:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d619ac96-3fff-4451-8d8a-58b9b458503f req-e64d4a6f-f59b-46b3-8ad2-af26e2000a41 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:15:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d619ac96-3fff-4451-8d8a-58b9b458503f req-e64d4a6f-f59b-46b3-8ad2-af26e2000a41 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:15:25 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-d619ac96-3fff-4451-8d8a-58b9b458503f req-e64d4a6f-f59b-46b3-8ad2-af26e2000a41 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:15:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-d619ac96-3fff-4451-8d8a-58b9b458503f req-e64d4a6f-f59b-46b3-8ad2-af26e2000a41 service nova] Creating event network-vif-plugged:731519ce-d7d2-4e48-85ad-db7c94def87a for instance d01cbd10-f562-4a76-8915-6c725d42dadd on user Apr 19 14:15:25 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-d619ac96-3fff-4451-8d8a-58b9b458503f req-e64d4a6f-f59b-46b3-8ad2-af26e2000a41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035630 Apr 19 14:15:25 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 147/438] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:15:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell0:SELECT=4 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-783aded9-e650-4349-8258-92118b548b38 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-783aded9-e650-4349-8258-92118b548b38 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-783aded9-e650-4349-8258-92118b548b38 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-783aded9-e650-4349-8258-92118b548b38 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-783aded9-e650-4349-8258-92118b548b38 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-783aded9-e650-4349-8258-92118b548b38 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-783aded9-e650-4349-8258-92118b548b38 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-783aded9-e650-4349-8258-92118b548b38 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:16:08 user devstack@n-api.service[61613]: DEBUG nova.policy [None req-783aded9-e650-4349-8258-92118b548b38 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8f62a56ad34e338cbd9f851af92966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27441f3068f845f7bb405083b2a447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61613) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:16:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-783aded9-e650-4349-8258-92118b548b38 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd" status: 200 len: 1539 microversion: 2.1 time: 0.308111 Apr 19 14:16:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 147/439] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:16:08 2023] GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd => generated 1539 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=2 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell0:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:17:08 user devstack@n-api.service[61612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 14:17:08 user devstack@n-api.service[61612]: Wed Apr 19 14:17:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd/os-interface (ip 10.0.0.210) !!! Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=6 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-9e36c27d-9a16-4c94-b524-aa713064356c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-9e36c27d-9a16-4c94-b524-aa713064356c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e36c27d-9a16-4c94-b524-aa713064356c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e36c27d-9a16-4c94-b524-aa713064356c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e36c27d-9a16-4c94-b524-aa713064356c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e36c27d-9a16-4c94-b524-aa713064356c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e36c27d-9a16-4c94-b524-aa713064356c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:08 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-9e36c27d-9a16-4c94-b524-aa713064356c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-9e36c27d-9a16-4c94-b524-aa713064356c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.186216 Apr 19 14:17:08 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 146/440] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 14:17:08 2023] GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd/os-interface => generated 283 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:17:09 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell0:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:17:09 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:17:09 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=2 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:17:09 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [req-55a339bd-babf-4129-9f2a-b715b1531e6d req-8ab880e6-9339-4a67-bb8c-c548eeecc38f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01cbd10-f562-4a76-8915-6c725d42dadd", "tag": "731519ce-d7d2-4e48-85ad-db7c94def87a"}]} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:17:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-55a339bd-babf-4129-9f2a-b715b1531e6d req-8ab880e6-9339-4a67-bb8c-c548eeecc38f service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-55a339bd-babf-4129-9f2a-b715b1531e6d req-8ab880e6-9339-4a67-bb8c-c548eeecc38f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:09 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [req-55a339bd-babf-4129-9f2a-b715b1531e6d req-8ab880e6-9339-4a67-bb8c-c548eeecc38f service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.compute.server_external_events [req-55a339bd-babf-4129-9f2a-b715b1531e6d req-8ab880e6-9339-4a67-bb8c-c548eeecc38f service nova] Creating event network-changed:731519ce-d7d2-4e48-85ad-db7c94def87a for instance d01cbd10-f562-4a76-8915-6c725d42dadd on user Apr 19 14:17:09 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=2 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:17:09 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [req-55a339bd-babf-4129-9f2a-b715b1531e6d req-8ab880e6-9339-4a67-bb8c-c548eeecc38f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045527 Apr 19 14:17:09 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 148/441] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:17:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:17:09 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:17:09 user devstack@n-api.service[61613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 14:17:09 user devstack@n-api.service[61613]: Wed Apr 19 14:17:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd/ips (ip 10.0.0.210) !!! Apr 19 14:17:09 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-c157c951-04e2-4711-9c04-1cd5ecf2cebb tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:17:09 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-c157c951-04e2-4711-9c04-1cd5ecf2cebb tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:17:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c157c951-04e2-4711-9c04-1cd5ecf2cebb tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c157c951-04e2-4711-9c04-1cd5ecf2cebb tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c157c951-04e2-4711-9c04-1cd5ecf2cebb tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c157c951-04e2-4711-9c04-1cd5ecf2cebb tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c157c951-04e2-4711-9c04-1cd5ecf2cebb tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:09 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-c157c951-04e2-4711-9c04-1cd5ecf2cebb tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:09 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-c157c951-04e2-4711-9c04-1cd5ecf2cebb tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd/ips" status: 200 len: 105 microversion: 2.1 time: 0.043205 Apr 19 14:17:09 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 148/442] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:17:09 2023] GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd/ips => generated 105 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:17:10 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c633612b-1d78-4eec-904c-ad4007d0052c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:17:10 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c633612b-1d78-4eec-904c-ad4007d0052c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:17:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c633612b-1d78-4eec-904c-ad4007d0052c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:10 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c633612b-1d78-4eec-904c-ad4007d0052c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c633612b-1d78-4eec-904c-ad4007d0052c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c633612b-1d78-4eec-904c-ad4007d0052c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c633612b-1d78-4eec-904c-ad4007d0052c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:11 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-c633612b-1d78-4eec-904c-ad4007d0052c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:11 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-c633612b-1d78-4eec-904c-ad4007d0052c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] Going to try to terminate instance {{(pid=61612) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 14:17:11 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c633612b-1d78-4eec-904c-ad4007d0052c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd" status: 204 len: 0 microversion: 2.1 time: 0.168175 Apr 19 14:17:11 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 147/443] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:17:10 2023] DELETE /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 14:17:11 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-07129fa1-36eb-4f1d-8326-114cc1926084 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:17:11 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-07129fa1-36eb-4f1d-8326-114cc1926084 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:17:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07129fa1-36eb-4f1d-8326-114cc1926084 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07129fa1-36eb-4f1d-8326-114cc1926084 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07129fa1-36eb-4f1d-8326-114cc1926084 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07129fa1-36eb-4f1d-8326-114cc1926084 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07129fa1-36eb-4f1d-8326-114cc1926084 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:11 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-07129fa1-36eb-4f1d-8326-114cc1926084 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:11 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-d2fe8a9e-6ed7-4edf-9fb8-3916632e7e91 req-43d5785f-3d84-4216-9cb5-b8638ed1a0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01cbd10-f562-4a76-8915-6c725d42dadd", "name": "network-vif-unplugged", "status": "completed", "tag": "731519ce-d7d2-4e48-85ad-db7c94def87a"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:17:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d2fe8a9e-6ed7-4edf-9fb8-3916632e7e91 req-43d5785f-3d84-4216-9cb5-b8638ed1a0ac service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d2fe8a9e-6ed7-4edf-9fb8-3916632e7e91 req-43d5785f-3d84-4216-9cb5-b8638ed1a0ac service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:11 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-d2fe8a9e-6ed7-4edf-9fb8-3916632e7e91 req-43d5785f-3d84-4216-9cb5-b8638ed1a0ac service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-d2fe8a9e-6ed7-4edf-9fb8-3916632e7e91 req-43d5785f-3d84-4216-9cb5-b8638ed1a0ac service nova] Creating event network-vif-unplugged:731519ce-d7d2-4e48-85ad-db7c94def87a for instance d01cbd10-f562-4a76-8915-6c725d42dadd on user Apr 19 14:17:11 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-d2fe8a9e-6ed7-4edf-9fb8-3916632e7e91 req-43d5785f-3d84-4216-9cb5-b8638ed1a0ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029045 Apr 19 14:17:11 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 149/444] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:17:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:17:11 user devstack@n-api.service[61611]: DEBUG nova.policy [None req-07129fa1-36eb-4f1d-8326-114cc1926084 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a8f62a56ad34e338cbd9f851af92966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27441f3068f845f7bb405083b2a447ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61611) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 14:17:11 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-07129fa1-36eb-4f1d-8326-114cc1926084 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd" status: 200 len: 1664 microversion: 2.1 time: 0.256994 Apr 19 14:17:11 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 149/445] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:17:11 2023] GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd => generated 1664 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 14:17:12 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [req-402c96bd-0bf2-4ddd-8fe8-69d62f711430 req-55b56ce7-a948-4656-814a-01e62de16531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01cbd10-f562-4a76-8915-6c725d42dadd", "name": "network-vif-deleted", "tag": "731519ce-d7d2-4e48-85ad-db7c94def87a"}]} {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:17:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-402c96bd-0bf2-4ddd-8fe8-69d62f711430 req-55b56ce7-a948-4656-814a-01e62de16531 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-402c96bd-0bf2-4ddd-8fe8-69d62f711430 req-55b56ce7-a948-4656-814a-01e62de16531 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:12 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [req-402c96bd-0bf2-4ddd-8fe8-69d62f711430 req-55b56ce7-a948-4656-814a-01e62de16531 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.compute.server_external_events [req-402c96bd-0bf2-4ddd-8fe8-69d62f711430 req-55b56ce7-a948-4656-814a-01e62de16531 service nova] Creating event network-vif-deleted:731519ce-d7d2-4e48-85ad-db7c94def87a for instance d01cbd10-f562-4a76-8915-6c725d42dadd on user Apr 19 14:17:12 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [req-402c96bd-0bf2-4ddd-8fe8-69d62f711430 req-55b56ce7-a948-4656-814a-01e62de16531 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034383 Apr 19 14:17:12 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 148/446] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:17:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:17:13 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [req-990b186a-fd7c-40c9-9f21-546b26bdffb8 req-746be7a7-0c76-4f5f-bff9-f1ba41e4d148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01cbd10-f562-4a76-8915-6c725d42dadd", "name": "network-vif-plugged", "status": "completed", "tag": "731519ce-d7d2-4e48-85ad-db7c94def87a"}]} {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:17:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-990b186a-fd7c-40c9-9f21-546b26bdffb8 req-746be7a7-0c76-4f5f-bff9-f1ba41e4d148 service nova] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:17:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-990b186a-fd7c-40c9-9f21-546b26bdffb8 req-746be7a7-0c76-4f5f-bff9-f1ba41e4d148 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:17:13 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [req-990b186a-fd7c-40c9-9f21-546b26bdffb8 req-746be7a7-0c76-4f5f-bff9-f1ba41e4d148 service nova] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:17:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.compute.server_external_events [req-990b186a-fd7c-40c9-9f21-546b26bdffb8 req-746be7a7-0c76-4f5f-bff9-f1ba41e4d148 service nova] Creating event network-vif-plugged:731519ce-d7d2-4e48-85ad-db7c94def87a for instance d01cbd10-f562-4a76-8915-6c725d42dadd on user Apr 19 14:17:13 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [req-990b186a-fd7c-40c9-9f21-546b26bdffb8 req-746be7a7-0c76-4f5f-bff9-f1ba41e4d148 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034736 Apr 19 14:17:13 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 150/447] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 14:17:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_api:SELECT=4 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG dbcounter [-] [61611] Writing DB stats nova_cell1:SELECT=8 {{(pid=61611) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:18:01 user devstack@n-api.service[61611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 14:18:01 user devstack@n-api.service[61611]: Wed Apr 19 14:18:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd (ip 10.0.0.210) !!! Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:18:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] HTTP exception thrown: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Request method failure captured: Apr 19 14:18:01 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd HTTP/1.1 Apr 19 14:18:01 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:18:01 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:18:01 user devstack@n-api.service[61611]: Connection: close Apr 19 14:18:01 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:18:01 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:18:01 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:18:01 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:18:01 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_bMAKQjOAXyDdoF0AHNOcSdxGBTYlmz0Ke6ZjjpCI-6gzzbZ7K4O58HWAkQlmnyNYfnHpYHrsibTy-oTDYpyB--O9MIRFdha20ABcJB_UA2S-LmPqAQpC-_awoUd6JGljF0sejchraCIQjNHiVeUgDhJUgI408ZgIyQmhypAG7Ga7A Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Project-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27441f3068f845f7bb405083b2a447ae"}]}] Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Tenant-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:18:01 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:01 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:18:01 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:18:01 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:18:01 user devstack@n-api.service[61611]: X-User-Id: 3a8f62a56ad34e338cbd9f851af92966 Apr 19 14:18:01 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:18:01 user devstack@n-api.service[61611]: method: > Apr 19 14:18:01 user devstack@n-api.service[61611]: exception: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:01 user devstack@n-api.service[61611]: action_args: {'id': 'd01cbd10-f562-4a76-8915-6c725d42dadd'} Apr 19 14:18:01 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:01 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:18:01 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Returning 404 to user: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:18:01 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-72847925-40af-474b-87b0-ece744104ce5 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd" status: 404 len: 111 microversion: 2.1 time: 0.113472 Apr 19 14:18:01 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 150/448] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:18:01 2023] GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:18:01 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:18:01 user devstack@n-api.service[61612]: DEBUG dbcounter [-] [61612] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61612) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:18:01 user devstack@n-api.service[61612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 14:18:01 user devstack@n-api.service[61612]: Wed Apr 19 14:18:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1744154661 (ip 10.0.0.210) !!! Apr 19 14:18:01 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-c72c1665-e87d-4703-b8ab-cb24f742454c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '.version_select at 0x7f60de257ac0>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:18:01 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-c72c1665-e87d-4703-b8ab-cb24f742454c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744154661" status: 202 len: 0 microversion: 2.1 time: 0.042680 Apr 19 14:18:01 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 149/449] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 14:18:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744154661 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_api:SELECT=6 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG dbcounter [-] [61613] Writing DB stats nova_cell1:SELECT=8 {{(pid=61613) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:18:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] HTTP exception thrown: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Request method failure captured: Apr 19 14:18:02 user devstack@n-api.service[61613]: request: DELETE /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd HTTP/1.1 Apr 19 14:18:02 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:18:02 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:18:02 user devstack@n-api.service[61613]: Connection: close Apr 19 14:18:02 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:18:02 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:18:02 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:18:02 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:18:02 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_bMAKQjOAXyDdoF0AHNOcSdxGBTYlmz0Ke6ZjjpCI-6gzzbZ7K4O58HWAkQlmnyNYfnHpYHrsibTy-oTDYpyB--O9MIRFdha20ABcJB_UA2S-LmPqAQpC-_awoUd6JGljF0sejchraCIQjNHiVeUgDhJUgI408ZgIyQmhypAG7Ga7A Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Project-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27441f3068f845f7bb405083b2a447ae"}]}] Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Tenant-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:18:02 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:18:02 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:18:02 user devstack@n-api.service[61613]: X-User-Id: 3a8f62a56ad34e338cbd9f851af92966 Apr 19 14:18:02 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:18:02 user devstack@n-api.service[61613]: method: > Apr 19 14:18:02 user devstack@n-api.service[61613]: exception: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:02 user devstack@n-api.service[61613]: action_args: {'id': 'd01cbd10-f562-4a76-8915-6c725d42dadd'} Apr 19 14:18:02 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Returning 404 to user: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:18:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-fb8054bd-83d0-4b57-ba39-3b58d44a2f9c tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd" status: 404 len: 111 microversion: 2.1 time: 0.038276 Apr 19 14:18:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 151/450] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:18:02 2023] DELETE /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:18:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:18:02 user devstack@n-api.service[61611]: DEBUG nova.compute.api [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: d01cbd10-f562-4a76-8915-6c725d42dadd] Fetching instance by UUID {{(pid=61611) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:18:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:18:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:18:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:18:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:18:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:18:02 user devstack@n-api.service[61611]: DEBUG oslo_concurrency.lockutils [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61611) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:18:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.wsgi [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] HTTP exception thrown: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Request method failure captured: Apr 19 14:18:02 user devstack@n-api.service[61611]: request: GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd HTTP/1.1 Apr 19 14:18:02 user devstack@n-api.service[61611]: Accept: application/json Apr 19 14:18:02 user devstack@n-api.service[61611]: Accept-Encoding: identity Apr 19 14:18:02 user devstack@n-api.service[61611]: Connection: close Apr 19 14:18:02 user devstack@n-api.service[61611]: Content-Length: 0 Apr 19 14:18:02 user devstack@n-api.service[61611]: Content-Type: application/json Apr 19 14:18:02 user devstack@n-api.service[61611]: Host: 10.0.0.210 Apr 19 14:18:02 user devstack@n-api.service[61611]: Openstack-System-Scope: None Apr 19 14:18:02 user devstack@n-api.service[61611]: User-Agent: python-urllib3/1.26.15 Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Auth-Token: gAAAAABkP_bMAKQjOAXyDdoF0AHNOcSdxGBTYlmz0Ke6ZjjpCI-6gzzbZ7K4O58HWAkQlmnyNYfnHpYHrsibTy-oTDYpyB--O9MIRFdha20ABcJB_UA2S-LmPqAQpC-_awoUd6JGljF0sejchraCIQjNHiVeUgDhJUgI408ZgIyQmhypAG7Ga7A Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Domain-Id: None Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Domain-Name: None Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Identity-Status: Confirmed Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Is-Admin-Project: True Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Project-Domain-Id: default Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Project-Domain-Name: Default Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Project-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Project-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Role: member,reader Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Roles: member,reader Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27441f3068f845f7bb405083b2a447ae"}]}] Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Tenant: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Tenant-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:18:02 user devstack@n-api.service[61611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61611]: X-User: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:18:02 user devstack@n-api.service[61611]: X-User-Domain-Id: default Apr 19 14:18:02 user devstack@n-api.service[61611]: X-User-Domain-Name: Default Apr 19 14:18:02 user devstack@n-api.service[61611]: X-User-Id: 3a8f62a56ad34e338cbd9f851af92966 Apr 19 14:18:02 user devstack@n-api.service[61611]: X-User-Name: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:18:02 user devstack@n-api.service[61611]: method: > Apr 19 14:18:02 user devstack@n-api.service[61611]: exception: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:02 user devstack@n-api.service[61611]: action_args: {'id': 'd01cbd10-f562-4a76-8915-6c725d42dadd'} Apr 19 14:18:02 user devstack@n-api.service[61611]: {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. Apr 19 14:18:02 user devstack@n-api.service[61611]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Returning 404 to user: Instance d01cbd10-f562-4a76-8915-6c725d42dadd could not be found. {{(pid=61611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:18:02 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-e3602069-6960-4aa1-a386-4d50759460e7 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd" status: 404 len: 111 microversion: 2.1 time: 0.034166 Apr 19 14:18:02 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 151/451] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:18:02 2023] GET /compute/v2.1/servers/d01cbd10-f562-4a76-8915-6c725d42dadd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:18:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:18:02 user devstack@n-api.service[61612]: DEBUG nova.compute.api [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] Fetching instance by UUID {{(pid=61612) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:18:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:18:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:18:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:18:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:18:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:18:02 user devstack@n-api.service[61612]: DEBUG oslo_concurrency.lockutils [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61612) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:18:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] HTTP exception thrown: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:18:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Request method failure captured: Apr 19 14:18:02 user devstack@n-api.service[61612]: request: DELETE /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a HTTP/1.1 Apr 19 14:18:02 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:18:02 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:18:02 user devstack@n-api.service[61612]: Connection: close Apr 19 14:18:02 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:18:02 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:18:02 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:18:02 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:18:02 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_bMAKQjOAXyDdoF0AHNOcSdxGBTYlmz0Ke6ZjjpCI-6gzzbZ7K4O58HWAkQlmnyNYfnHpYHrsibTy-oTDYpyB--O9MIRFdha20ABcJB_UA2S-LmPqAQpC-_awoUd6JGljF0sejchraCIQjNHiVeUgDhJUgI408ZgIyQmhypAG7Ga7A Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Project-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Project-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27441f3068f845f7bb405083b2a447ae"}]}] Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Tenant: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Tenant-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:18:02 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61612]: X-User: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:18:02 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:18:02 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:18:02 user devstack@n-api.service[61612]: X-User-Id: 3a8f62a56ad34e338cbd9f851af92966 Apr 19 14:18:02 user devstack@n-api.service[61612]: X-User-Name: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:18:02 user devstack@n-api.service[61612]: method: > Apr 19 14:18:02 user devstack@n-api.service[61612]: exception: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:18:02 user devstack@n-api.service[61612]: action_args: {'id': '6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a'} Apr 19 14:18:02 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:18:02 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Returning 404 to user: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:18:02 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-f7b8e1b7-7721-4595-a107-4855ba6194b1 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a" status: 404 len: 111 microversion: 2.1 time: 0.028820 Apr 19 14:18:02 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 150/452] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 14:18:02 2023] DELETE /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Calling method '>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG nova.compute.api [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] [instance: 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a] Fetching instance by UUID {{(pid=61613) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Acquiring lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG oslo_concurrency.lockutils [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Lock "2620343c-c8d1-48e6-ac23-7775ee8493ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61613) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 14:18:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.wsgi [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] HTTP exception thrown: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Request method failure captured: Apr 19 14:18:02 user devstack@n-api.service[61613]: request: GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a HTTP/1.1 Apr 19 14:18:02 user devstack@n-api.service[61613]: Accept: application/json Apr 19 14:18:02 user devstack@n-api.service[61613]: Accept-Encoding: identity Apr 19 14:18:02 user devstack@n-api.service[61613]: Connection: close Apr 19 14:18:02 user devstack@n-api.service[61613]: Content-Length: 0 Apr 19 14:18:02 user devstack@n-api.service[61613]: Content-Type: application/json Apr 19 14:18:02 user devstack@n-api.service[61613]: Host: 10.0.0.210 Apr 19 14:18:02 user devstack@n-api.service[61613]: Openstack-System-Scope: None Apr 19 14:18:02 user devstack@n-api.service[61613]: User-Agent: python-urllib3/1.26.15 Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Auth-Token: gAAAAABkP_bMAKQjOAXyDdoF0AHNOcSdxGBTYlmz0Ke6ZjjpCI-6gzzbZ7K4O58HWAkQlmnyNYfnHpYHrsibTy-oTDYpyB--O9MIRFdha20ABcJB_UA2S-LmPqAQpC-_awoUd6JGljF0sejchraCIQjNHiVeUgDhJUgI408ZgIyQmhypAG7Ga7A Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Domain-Id: None Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Domain-Name: None Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Identity-Status: Confirmed Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Is-Admin-Project: True Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Project-Domain-Id: default Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Project-Domain-Name: Default Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Project-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Project-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Role: member,reader Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Roles: member,reader Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27441f3068f845f7bb405083b2a447ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27441f3068f845f7bb405083b2a447ae"}]}] Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Tenant: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Tenant-Id: 27441f3068f845f7bb405083b2a447ae Apr 19 14:18:02 user devstack@n-api.service[61613]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1633221555 Apr 19 14:18:02 user devstack@n-api.service[61613]: X-User: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:18:02 user devstack@n-api.service[61613]: X-User-Domain-Id: default Apr 19 14:18:02 user devstack@n-api.service[61613]: X-User-Domain-Name: Default Apr 19 14:18:02 user devstack@n-api.service[61613]: X-User-Id: 3a8f62a56ad34e338cbd9f851af92966 Apr 19 14:18:02 user devstack@n-api.service[61613]: X-User-Name: tempest-AttachVolumeTestJSON-1633221555-project-member Apr 19 14:18:02 user devstack@n-api.service[61613]: method: > Apr 19 14:18:02 user devstack@n-api.service[61613]: exception: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:18:02 user devstack@n-api.service[61613]: action_args: {'id': '6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a'} Apr 19 14:18:02 user devstack@n-api.service[61613]: {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. Apr 19 14:18:02 user devstack@n-api.service[61613]: ERROR nova.api.openstack.wsgi Apr 19 14:18:02 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] Returning 404 to user: Instance 6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a could not be found. {{(pid=61613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:18:02 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-2acb33a8-02ef-4d59-ba83-f967bc294465 tempest-AttachVolumeTestJSON-1633221555 tempest-AttachVolumeTestJSON-1633221555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a" status: 404 len: 111 microversion: 2.1 time: 0.026952 Apr 19 14:18:02 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 152/453] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 14:18:02 2023] GET /compute/v2.1/servers/6e2d8d6f-0491-4fb2-9f4f-ac12d2edd77a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 14:18:07 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-2fd38815-2ef1-4eb9-9e49-d4a32eb5ab98 tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] Action: 'create', calling method: .version_select at 0x7f60de3bc1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1476632306", "metadata": {"Type": "work"}}} {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 14:18:07 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-2fd38815-2ef1-4eb9-9e49-d4a32eb5ab98 tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.570551 Apr 19 14:18:07 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 152/454] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 14:18:06 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 572 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 19 14:18:07 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-035fcc1c-fb7b-49d3-a031-bfc947897dd8 tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] Calling method '.version_select at 0x7f60de255990>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:18:07 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-035fcc1c-fb7b-49d3-a031-bfc947897dd8 tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/fb91b9fb-8349-4cd2-bb01-8e836dc877ea" status: 200 len: 350 microversion: 2.1 time: 0.054106 Apr 19 14:18:07 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 151/455] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 14:18:07 2023] GET /compute/v2.1/os-volumes/fb91b9fb-8349-4cd2-bb01-8e836dc877ea => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:18:08 user devstack@n-api.service[61613]: DEBUG nova.api.openstack.wsgi [None req-7b79c5d4-783d-4329-aec2-9219d161f76c tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] Calling method '.version_select at 0x7f60de378c10>' {{(pid=61613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:18:08 user devstack@n-api.service[61613]: INFO nova.api.openstack.requestlog [None req-7b79c5d4-783d-4329-aec2-9219d161f76c tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/fb91b9fb-8349-4cd2-bb01-8e836dc877ea" status: 200 len: 350 microversion: 2.1 time: 0.105614 Apr 19 14:18:08 user devstack@n-api.service[61613]: [pid: 61613|app: 0|req: 153/456] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 14:18:08 2023] GET /compute/v2.1/os-volumes/fb91b9fb-8349-4cd2-bb01-8e836dc877ea => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 14:18:08 user devstack@n-api.service[61611]: DEBUG nova.api.openstack.wsgi [None req-ea521f17-8d3e-4026-8dd2-6bdc14d22b37 tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] Calling method '.version_select at 0x7f60de119900>' {{(pid=61611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:18:08 user devstack@n-api.service[61611]: INFO nova.api.openstack.requestlog [None req-ea521f17-8d3e-4026-8dd2-6bdc14d22b37 tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/fb91b9fb-8349-4cd2-bb01-8e836dc877ea" status: 202 len: 0 microversion: 2.1 time: 0.112703 Apr 19 14:18:08 user devstack@n-api.service[61611]: [pid: 61611|app: 0|req: 153/457] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 14:18:08 2023] DELETE /compute/v2.1/os-volumes/fb91b9fb-8349-4cd2-bb01-8e836dc877ea => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 14:18:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-00af2731-26b9-40f3-aad0-c39a941ab22e tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] Calling method '.version_select at 0x7f60de257c70>' {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 14:18:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.wsgi [None req-00af2731-26b9-40f3-aad0-c39a941ab22e tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] HTTP exception thrown: Volume fb91b9fb-8349-4cd2-bb01-8e836dc877ea could not be found. Apr 19 14:18:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-00af2731-26b9-40f3-aad0-c39a941ab22e tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] Request method failure captured: Apr 19 14:18:08 user devstack@n-api.service[61612]: request: GET /compute/v2.1/os-volumes/fb91b9fb-8349-4cd2-bb01-8e836dc877ea HTTP/1.1 Apr 19 14:18:08 user devstack@n-api.service[61612]: Accept: application/json Apr 19 14:18:08 user devstack@n-api.service[61612]: Accept-Encoding: identity Apr 19 14:18:08 user devstack@n-api.service[61612]: Connection: close Apr 19 14:18:08 user devstack@n-api.service[61612]: Content-Length: 0 Apr 19 14:18:08 user devstack@n-api.service[61612]: Content-Type: application/json Apr 19 14:18:08 user devstack@n-api.service[61612]: Host: 10.0.0.210 Apr 19 14:18:08 user devstack@n-api.service[61612]: Openstack-System-Scope: None Apr 19 14:18:08 user devstack@n-api.service[61612]: User-Agent: python-urllib3/1.26.15 Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Auth-Token: gAAAAABkP_geiVaBiK4t14JbMTJQVscA2RZJ5wLx7M2ugbxdX4JdwweQgNilfsBSZ6cvDG1nhYL24W85a8OrS8Jtw2V5Clbiyl39sig3NN2lJ0ivyLUa31SA6CM_7WVmkcOj7w0wWVNJxE1Ydzyd9yzRIFMLuirQuIs--mu-PGz7Hdl61YOF7dM Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Domain-Id: None Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Domain-Name: None Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Identity-Status: Confirmed Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Is-Admin-Project: True Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Project-Domain-Id: default Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Project-Domain-Name: Default Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Project-Id: e39ba10638bb4620890ac4ddfa514960 Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Project-Name: tempest-VolumesGetTestJSON-1731317764 Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Role: member,reader Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Roles: member,reader Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e39ba10638bb4620890ac4ddfa514960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e39ba10638bb4620890ac4ddfa514960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e39ba10638bb4620890ac4ddfa514960"}]}] Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Tenant: tempest-VolumesGetTestJSON-1731317764 Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Tenant-Id: e39ba10638bb4620890ac4ddfa514960 Apr 19 14:18:08 user devstack@n-api.service[61612]: X-Tenant-Name: tempest-VolumesGetTestJSON-1731317764 Apr 19 14:18:08 user devstack@n-api.service[61612]: X-User: tempest-VolumesGetTestJSON-1731317764-project-member Apr 19 14:18:08 user devstack@n-api.service[61612]: X-User-Domain-Id: default Apr 19 14:18:08 user devstack@n-api.service[61612]: X-User-Domain-Name: Default Apr 19 14:18:08 user devstack@n-api.service[61612]: X-User-Id: 16f377e3bec74996b7c045e52b975e77 Apr 19 14:18:08 user devstack@n-api.service[61612]: X-User-Name: tempest-VolumesGetTestJSON-1731317764-project-member Apr 19 14:18:08 user devstack@n-api.service[61612]: method: Apr 19 14:18:08 user devstack@n-api.service[61612]: exception: Volume fb91b9fb-8349-4cd2-bb01-8e836dc877ea could not be found. Apr 19 14:18:08 user devstack@n-api.service[61612]: action_args: {'id': 'fb91b9fb-8349-4cd2-bb01-8e836dc877ea'} Apr 19 14:18:08 user devstack@n-api.service[61612]: {{(pid=61612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb91b9fb-8349-4cd2-bb01-8e836dc877ea could not be found. (HTTP 404) (Request-ID: req-2c132b66-33b1-44bb-8f93-4fd96192f33c) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb91b9fb-8349-4cd2-bb01-8e836dc877ea could not be found. Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb91b9fb-8349-4cd2-bb01-8e836dc877ea could not be found. Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb91b9fb-8349-4cd2-bb01-8e836dc877ea could not be found. Apr 19 14:18:08 user devstack@n-api.service[61612]: ERROR nova.api.openstack.wsgi Apr 19 14:18:08 user devstack@n-api.service[61612]: DEBUG nova.api.openstack.wsgi [None req-00af2731-26b9-40f3-aad0-c39a941ab22e tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] Returning 404 to user: Volume fb91b9fb-8349-4cd2-bb01-8e836dc877ea could not be found. {{(pid=61612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 14:18:08 user devstack@n-api.service[61612]: INFO nova.api.openstack.requestlog [None req-00af2731-26b9-40f3-aad0-c39a941ab22e tempest-VolumesGetTestJSON-1731317764 tempest-VolumesGetTestJSON-1731317764-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/fb91b9fb-8349-4cd2-bb01-8e836dc877ea" status: 404 len: 109 microversion: 2.1 time: 0.041138 Apr 19 14:18:08 user devstack@n-api.service[61612]: [pid: 61612|app: 0|req: 152/458] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 14:18:08 2023] GET /compute/v2.1/os-volumes/fb91b9fb-8349-4cd2-bb01-8e836dc877ea => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)