Apr 20 15:02:08 user devstack@n-api.service[61507]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 15:02:08 user devstack@n-api.service[61507]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 20 15:02:08 2023] *** Apr 20 15:02:08 user devstack@n-api.service[61507]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 20 15:02:08 user devstack@n-api.service[61507]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 20 15:02:08 user devstack@n-api.service[61507]: nodename: user Apr 20 15:02:08 user devstack@n-api.service[61507]: machine: x86_64 Apr 20 15:02:08 user devstack@n-api.service[61507]: clock source: unix Apr 20 15:02:08 user devstack@n-api.service[61507]: pcre jit disabled Apr 20 15:02:08 user devstack@n-api.service[61507]: detected number of CPU cores: 12 Apr 20 15:02:08 user devstack@n-api.service[61507]: current working directory: / Apr 20 15:02:08 user devstack@n-api.service[61507]: detected binary path: /usr/bin/uwsgi-core Apr 20 15:02:08 user devstack@n-api.service[61507]: your processes number limit is 63637 Apr 20 15:02:08 user devstack@n-api.service[61507]: your memory page size is 4096 bytes Apr 20 15:02:08 user devstack@n-api.service[61507]: detected max file descriptor number: 2048 Apr 20 15:02:08 user devstack@n-api.service[61507]: lock engine: pthread robust mutexes Apr 20 15:02:08 user devstack@n-api.service[61507]: thunder lock: enabled Apr 20 15:02:08 user devstack@n-api.service[61507]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 15:02:08 user devstack@n-api.service[61507]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 20 15:02:08 user devstack@n-api.service[61507]: Python main interpreter initialized at 0x557018f0d990 Apr 20 15:02:08 user devstack@n-api.service[61507]: python threads support enabled Apr 20 15:02:08 user devstack@n-api.service[61507]: your server socket listen backlog is limited to 100 connections Apr 20 15:02:08 user devstack@n-api.service[61507]: your mercy for graceful operations on workers is 90 seconds Apr 20 15:02:08 user devstack@n-api.service[61507]: mapped 537436 bytes (524 KB) for 3 cores Apr 20 15:02:08 user devstack@n-api.service[61507]: *** Operational MODE: preforking *** Apr 20 15:02:08 user devstack@n-api.service[61507]: *** uWSGI is running in multiple interpreter mode *** Apr 20 15:02:08 user devstack@n-api.service[61507]: spawned uWSGI master process (pid: 61507) Apr 20 15:02:08 user devstack@n-api.service[61507]: spawned uWSGI worker 1 (pid: 61508, cores: 1) Apr 20 15:02:08 user devstack@n-api.service[61507]: spawned uWSGI worker 2 (pid: 61509, cores: 1) Apr 20 15:02:08 user devstack@n-api.service[61507]: spawned uWSGI worker 3 (pid: 61510, cores: 1) Apr 20 15:02:08 user devstack@n-api.service[61507]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 15:02:09 user devstack@n-api.service[61510]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 15:02:09 user devstack@n-api.service[61508]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 15:02:09 user devstack@n-api.service[61509]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 15:02:12 user devstack@n-api.service[61510]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 15:02:12 user devstack@n-api.service[61510]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 15:02:12 user devstack@n-api.service[61510]: and ``live_migration_inbound_addr`` respectively. Apr 20 15:02:12 user devstack@n-api.service[61510]: ). Its value may be silently ignored in the future. Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 15:02:12 user devstack@n-api.service[61509]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 15:02:12 user devstack@n-api.service[61509]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 15:02:12 user devstack@n-api.service[61509]: and ``live_migration_inbound_addr`` respectively. Apr 20 15:02:12 user devstack@n-api.service[61509]: ). Its value may be silently ignored in the future. Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 15:02:12 user devstack@n-api.service[61508]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 15:02:12 user devstack@n-api.service[61508]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 15:02:12 user devstack@n-api.service[61508]: and ``live_migration_inbound_addr`` respectively. Apr 20 15:02:12 user devstack@n-api.service[61508]: ). Its value may be silently ignored in the future. Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61508) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 15:02:12 user devstack@n-api.service[61510]: INFO dbcounter [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Registered counter for database nova_api Apr 20 15:02:12 user devstack@n-api.service[61509]: INFO dbcounter [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Registered counter for database nova_api Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG oslo_db.sqlalchemy.engines [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61510) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writer thread running {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG oslo_db.sqlalchemy.engines [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61509) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writer thread running {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:12 user devstack@n-api.service[61508]: INFO dbcounter [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Registered counter for database nova_api Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG nova.context [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9259cc4-6390-40ae-86fb-bec94ff13c9d(cell1) {{(pid=61510) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:02:12 user devstack@n-api.service[61510]: INFO dbcounter [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Registered counter for database nova_cell0 Apr 20 15:02:12 user devstack@n-api.service[61510]: INFO dbcounter [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Registered counter for database nova_cell1 Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG nova.context [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9259cc4-6390-40ae-86fb-bec94ff13c9d(cell1) {{(pid=61509) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG oslo_db.sqlalchemy.engines [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61510) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG oslo_db.sqlalchemy.engines [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61510) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writer thread running {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:02:12 user devstack@n-api.service[61509]: INFO dbcounter [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Registered counter for database nova_cell0 Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG oslo_db.sqlalchemy.engines [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61508) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:12 user devstack@n-api.service[61509]: INFO dbcounter [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Registered counter for database nova_cell1 Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writer thread running {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG oslo_db.sqlalchemy.engines [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61509) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writer thread running {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG oslo_db.sqlalchemy.engines [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61509) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG nova.context [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9259cc4-6390-40ae-86fb-bec94ff13c9d(cell1) {{(pid=61508) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:02:12 user devstack@n-api.service[61508]: INFO dbcounter [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Registered counter for database nova_cell0 Apr 20 15:02:12 user devstack@n-api.service[61508]: INFO dbcounter [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Registered counter for database nova_cell1 Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG oslo_db.sqlalchemy.engines [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61508) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writer thread running {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:12 user devstack@n-api.service[61508]: DEBUG oslo_db.sqlalchemy.engines [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61508) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writer thread running {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:12 user devstack@n-api.service[61510]: INFO dbcounter [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Registered counter for database nova_cell0 Apr 20 15:02:12 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writer thread running {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG oslo_db.sqlalchemy.engines [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61510) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:12 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writer thread running {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:12 user devstack@n-api.service[61509]: INFO dbcounter [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Registered counter for database nova_cell0 Apr 20 15:02:13 user devstack@n-api.service[61509]: DEBUG oslo_db.sqlalchemy.engines [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61509) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:13 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writer thread running {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:13 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writer thread running {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:13 user devstack@n-api.service[61508]: INFO dbcounter [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Registered counter for database nova_cell0 Apr 20 15:02:13 user devstack@n-api.service[61508]: DEBUG oslo_db.sqlalchemy.engines [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61508) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:02:13 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writer thread running {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:02:13 user devstack@n-api.service[61510]: WARNING keystonemiddleware.auth_token [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:02:13 user devstack@n-api.service[61510]: WARNING keystonemiddleware.auth_token [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:02:13 user devstack@n-api.service[61509]: WARNING keystonemiddleware.auth_token [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:02:13 user devstack@n-api.service[61509]: WARNING keystonemiddleware.auth_token [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:02:13 user devstack@n-api.service[61510]: WARNING keystonemiddleware.auth_token [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:02:13 user devstack@n-api.service[61510]: WARNING keystonemiddleware.auth_token [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:02:13 user devstack@n-api.service[61510]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557018f0d990 pid: 61510 (default app) Apr 20 15:02:13 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:02:13 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001468 Apr 20 15:02:13 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 20 15:02:13 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:02:13 user devstack@n-api.service[61508]: WARNING keystonemiddleware.auth_token [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:02:13 user devstack@n-api.service[61508]: WARNING keystonemiddleware.auth_token [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:02:13 user devstack@n-api.service[61509]: WARNING keystonemiddleware.auth_token [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:02:13 user devstack@n-api.service[61509]: WARNING keystonemiddleware.auth_token [None req-31d1f91f-9f59-4396-93f1-763317aaa637 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:02:13 user devstack@n-api.service[61509]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557018f0d990 pid: 61509 (default app) Apr 20 15:02:13 user devstack@n-api.service[61508]: WARNING keystonemiddleware.auth_token [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:02:13 user devstack@n-api.service[61508]: WARNING keystonemiddleware.auth_token [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:02:13 user devstack@n-api.service[61508]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557018f0d990 pid: 61508 (default app) Apr 20 15:04:22 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:22 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-6630fd10-9be0-4a9a-b185-9925225fd1c0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001445 Apr 20 15:04:22 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:22 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:22 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:22 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:22 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:22 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-687ed649-5cbb-4553-89ed-a72ba44cc506 admin admin] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:22 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-687ed649-5cbb-4553-89ed-a72ba44cc506 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.401882 Apr 20 15:04:22 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 15:04:22 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:04:24 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:24 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002266 Apr 20 15:04:24 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:24 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:24 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:24 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:24 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:24 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:24 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-64f8f1e6-5055-4daa-a0ad-5b5afc7bfb45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "ram": 256}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:24 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-64f8f1e6-5055-4daa-a0ad-5b5afc7bfb45 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.305592 Apr 20 15:04:24 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:04:24 2023] POST /compute/v2.1/flavors => generated 405 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:04:24 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-3def5671-06c9-404a-b815-26788e04520f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:24 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-3def5671-06c9-404a-b815-26788e04520f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057694 Apr 20 15:04:24 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 15:04:24 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:04:27 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:27 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001397 Apr 20 15:04:27 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:27 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ef4429e1-e1f7-4e28-96d9-ec09d13071a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:27 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-ef4429e1-e1f7-4e28-96d9-ec09d13071a8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059740 Apr 20 15:04:27 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:04:27 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:04:27 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-fe97303d-8a05-4327-a45e-92125fb71c58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:27 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-fe97303d-8a05-4327-a45e-92125fb71c58 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031401 Apr 20 15:04:27 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 15:04:27 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:04:29 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:29 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001387 Apr 20 15:04:29 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:29 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-27f5e086-56b0-4602-95fa-143b684f2bc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024, "swap": 0, "vcpus": 1}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:29 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-27f5e086-56b0-4602-95fa-143b684f2bc6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071766 Apr 20 15:04:29 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:04:29 2023] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:04:29 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-9b0ea83b-fd77-4a77-977c-183395770f90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:29 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-9b0ea83b-fd77-4a77-977c-183395770f90 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029498 Apr 20 15:04:29 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 15:04:29 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:04:31 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:31 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001333 Apr 20 15:04:31 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:31 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-34e21e72-c3d9-400c-bcba-a018f68b77a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "id": "d3", "rxtx_factor": 1.0}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:31 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-34e21e72-c3d9-400c-bcba-a018f68b77a1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058759 Apr 20 15:04:31 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:04:31 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:04:31 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-beb92435-b83b-44dd-b568-ef60d9b7cb2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:31 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-beb92435-b83b-44dd-b568-ef60d9b7cb2f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023786 Apr 20 15:04:31 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 15:04:31 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:04:33 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:33 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001694 Apr 20 15:04:33 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:33 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:33 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6e89f04b-786f-40ca-b601-9e179f863385 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "id": "d4"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:33 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-6e89f04b-786f-40ca-b601-9e179f863385 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.055692 Apr 20 15:04:33 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:04:33 2023] POST /compute/v2.1/flavors => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:04:33 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:33 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024501 Apr 20 15:04:33 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 15:04:33 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:04:35 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:35 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-0483e5eb-c98b-4d41-a634-5f1dc4d948d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001930 Apr 20 15:04:35 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:35 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:35 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c5ccd239-9ba2-4bf0-afcf-5f7137a77b82 admin admin] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c5ccd239-9ba2-4bf0-afcf-5f7137a77b82 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.066734 Apr 20 15:04:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 15:04:35 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:04:37 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:37 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001523 Apr 20 15:04:37 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:37 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:37 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=3 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:37 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=3 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:37 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=3 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:37 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=3 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:04:37 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-e0d288a0-be5d-498a-980a-b76a6d25b2f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 512, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-e0d288a0-be5d-498a-980a-b76a6d25b2f0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.308738 Apr 20 15:04:37 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:04:37 2023] POST /compute/v2.1/flavors => generated 400 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:04:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-3e44659d-05c4-490d-8170-aabeec1262ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-3e44659d-05c4-490d-8170-aabeec1262ac admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037050 Apr 20 15:04:37 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 15:04:37 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:04:39 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:39 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001334 Apr 20 15:04:39 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:39 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:39 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-f017fb4b-d105-41bc-b8cb-ab52616b7add admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:39 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-f017fb4b-d105-41bc-b8cb-ab52616b7add admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.056586 Apr 20 15:04:39 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:04:39 2023] POST /compute/v2.1/flavors => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:04:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-d61bb079-00fa-4d7d-9882-de77c66c53d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-d61bb079-00fa-4d7d-9882-de77c66c53d4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028710 Apr 20 15:04:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 15:04:39 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:04:41 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:41 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001502 Apr 20 15:04:41 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:41 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:41 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-1e41e65b-48e7-49ba-a699-9ab6dffe596c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3"}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:41 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-1e41e65b-48e7-49ba-a699-9ab6dffe596c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.065075 Apr 20 15:04:41 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:04:41 2023] POST /compute/v2.1/flavors => generated 404 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:04:41 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-362776cf-c757-423a-810c-5c4758e0fd4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:41 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-362776cf-c757-423a-810c-5c4758e0fd4d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027457 Apr 20 15:04:41 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 15:04:41 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:04:43 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:43 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001371 Apr 20 15:04:43 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:43 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:43 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-a5ae5a1a-ce80-4c0b-815e-1cbb85143bc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:43 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-a5ae5a1a-ce80-4c0b-815e-1cbb85143bc4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062296 Apr 20 15:04:43 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:04:43 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:04:43 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-95ee238c-de48-4052-9f1c-7de5a3734fc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:43 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-95ee238c-de48-4052-9f1c-7de5a3734fc5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024571 Apr 20 15:04:43 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 15:04:43 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:04:45 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:04:45 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002000 Apr 20 15:04:45 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:04:45 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:04:45 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-b9e46498-0507-45ea-9874-3aaca78648b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "swap": 0}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:45 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-b9e46498-0507-45ea-9874-3aaca78648b9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.061941 Apr 20 15:04:45 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:04:45 2023] POST /compute/v2.1/flavors => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:04:45 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-3d0e12b7-4654-45b3-ad57-c1437b51e328 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:04:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-3d0e12b7-4654-45b3-ad57-c1437b51e328 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023590 Apr 20 15:04:45 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 15:04:45 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:05:21 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:05:21 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-5c038683-c856-46bd-9299-df5f57ac2a3e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001378 Apr 20 15:05:21 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 15:05:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:05:21 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:05:21 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:05:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:05:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:05:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:05:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:05:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:05:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:05:21 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.086864 Apr 20 15:05:21 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 20 15:05:21 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:05:52 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-3d0e12b7-4654-45b3-ad57-c1437b51e328 admin admin] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:05:52 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-3d0e12b7-4654-45b3-ad57-c1437b51e328 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001455 Apr 20 15:05:52 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 15:05:52 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:05:52 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:05:52 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-b2bb6105-1ac5-44b7-b5ac-d6aa036a4374 admin admin] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:05:52 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-b2bb6105-1ac5-44b7-b5ac-d6aa036a4374 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.110879 Apr 20 15:05:52 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 20 15:05:52 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:05:57 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:05:57 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001529 Apr 20 15:05:57 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 15:05:56 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:05:57 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:05:57 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-20bf113d-64ea-4883-95c2-c7042b6f61f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.nano", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 128, "id": "42"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:05:57 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-20bf113d-64ea-4883-95c2-c7042b6f61f0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.167116 Apr 20 15:05:57 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 15:05:57 2023] POST /compute/v2.1/flavors => generated 403 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:05:57 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-14aa0ff8-1e27-4232-8e76-c71f4aeff0fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:05:57 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-14aa0ff8-1e27-4232-8e76-c71f4aeff0fe admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028770 Apr 20 15:05:57 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 15:05:57 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:06:01 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:06:01 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-1b806fa2-6405-4d45-8aa4-01b274a7eb33 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001392 Apr 20 15:06:01 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 15:06:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:06:01 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-0739ee46-29bd-45fc-9311-6cfb9721ddf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "84", "disk": 1, "os-flavor-access:is_public": true, "name": "m1.micro", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 192}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:06:01 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-0739ee46-29bd-45fc-9311-6cfb9721ddf8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069759 Apr 20 15:06:01 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 15:06:01 2023] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:06:01 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-0723a707-be09-4e60-9661-723737b38921 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:06:01 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-0723a707-be09-4e60-9661-723737b38921 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025326 Apr 20 15:06:01 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 15:06:01 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:08:12 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:08:12 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:08:12 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:08:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-70e7492f-de0a-4098-b5cb-10f951cb93ea tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Action: 'create', calling method: .version_select at 0x7fcbb449f0a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2056367972", "metadata": {"Type": "work"}}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-70e7492f-de0a-4098-b5cb-10f951cb93ea tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Request method failure captured: Apr 20 15:08:12 user devstack@n-api.service[61508]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 15:08:12 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:08:12 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:08:12 user devstack@n-api.service[61508]: Connection: close Apr 20 15:08:12 user devstack@n-api.service[61508]: Content-Length: 122 Apr 20 15:08:12 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:08:12 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:08:12 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:08:12 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVcLs53QiQzjA_nN75b4aCDzi6DecB2Mi0hFiaQpabZKY1in3Z3f0my5PcYwqT895d55WQ1h_mG54kRiaSkRTe2CmGnH364AAILWtcCmG8einK1F0q9bOD1xQ33xdAlafT-d7oki3O56kF7D07-z4L3EVSda8lMFgakS0-kLCQo7cw Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Project-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Project-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9157aeb0517b4958911951fa2a0e4a37"}]}] Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Tenant: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Tenant-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:12 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:12 user devstack@n-api.service[61508]: X-User: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:12 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:08:12 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:08:12 user devstack@n-api.service[61508]: X-User-Id: b3b094a3cb97455395ffee8191d0644c Apr 20 15:08:12 user devstack@n-api.service[61508]: X-User-Name: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:12 user devstack@n-api.service[61508]: Apr 20 15:08:12 user devstack@n-api.service[61508]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2056367972", "metadata": {"Type": "work"}}} Apr 20 15:08:12 user devstack@n-api.service[61508]: method: Apr 20 15:08:12 user devstack@n-api.service[61508]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 15:08:12 user devstack@n-api.service[61508]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2056367972', 'metadata': {'Type': 'work'}}}} Apr 20 15:08:12 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise error Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi '#$%' Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 15:08:12 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-70e7492f-de0a-4098-b5cb-10f951cb93ea tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:08:12 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-70e7492f-de0a-4098-b5cb-10f951cb93ea tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.345154 Apr 20 15:08:12 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 15:08:12 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 348 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:08:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ce74ed05-fbcd-41b5-a430-64c00ce66302 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Action: 'create', calling method: .version_select at 0x7fcbb449e4d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1333946867", "metadata": {"Type": "work"}}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ce74ed05-fbcd-41b5-a430-64c00ce66302 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Request method failure captured: Apr 20 15:08:12 user devstack@n-api.service[61510]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 15:08:12 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:08:12 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:08:12 user devstack@n-api.service[61510]: Connection: close Apr 20 15:08:12 user devstack@n-api.service[61510]: Content-Length: 120 Apr 20 15:08:12 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:08:12 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:08:12 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:08:12 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVVcLs53QiQzjA_nN75b4aCDzi6DecB2Mi0hFiaQpabZKY1in3Z3f0my5PcYwqT895d55WQ1h_mG54kRiaSkRTe2CmGnH364AAILWtcCmG8einK1F0q9bOD1xQ33xdAlafT-d7oki3O56kF7D07-z4L3EVSda8lMFgakS0-kLCQo7cw Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Project-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Project-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9157aeb0517b4958911951fa2a0e4a37"}]}] Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Tenant: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Tenant-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:12 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:12 user devstack@n-api.service[61510]: X-User: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:12 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:08:12 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:08:12 user devstack@n-api.service[61510]: X-User-Id: b3b094a3cb97455395ffee8191d0644c Apr 20 15:08:12 user devstack@n-api.service[61510]: X-User-Name: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:12 user devstack@n-api.service[61510]: Apr 20 15:08:12 user devstack@n-api.service[61510]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1333946867", "metadata": {"Type": "work"}}} Apr 20 15:08:12 user devstack@n-api.service[61510]: method: Apr 20 15:08:12 user devstack@n-api.service[61510]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 15:08:12 user devstack@n-api.service[61510]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1333946867', 'metadata': {'Type': 'work'}}}} Apr 20 15:08:12 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise error Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi '0' Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 15:08:12 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ce74ed05-fbcd-41b5-a430-64c00ce66302 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:08:12 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-ce74ed05-fbcd-41b5-a430-64c00ce66302 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013247 Apr 20 15:08:12 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 15:08:12 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:08:12 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:08:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-686a10e3-a4f0-45be-a5eb-6dc1d9b3dc36 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Action: 'create', calling method: .version_select at 0x7fcbb45ab490>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1788728579", "metadata": {"Type": "work"}}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-686a10e3-a4f0-45be-a5eb-6dc1d9b3dc36 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Request method failure captured: Apr 20 15:08:12 user devstack@n-api.service[61509]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 15:08:12 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:08:12 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:08:12 user devstack@n-api.service[61509]: Connection: close Apr 20 15:08:12 user devstack@n-api.service[61509]: Content-Length: 119 Apr 20 15:08:12 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:08:12 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:08:12 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:08:12 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVVcLs53QiQzjA_nN75b4aCDzi6DecB2Mi0hFiaQpabZKY1in3Z3f0my5PcYwqT895d55WQ1h_mG54kRiaSkRTe2CmGnH364AAILWtcCmG8einK1F0q9bOD1xQ33xdAlafT-d7oki3O56kF7D07-z4L3EVSda8lMFgakS0-kLCQo7cw Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Project-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Project-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9157aeb0517b4958911951fa2a0e4a37"}]}] Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Tenant: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Tenant-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:12 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:12 user devstack@n-api.service[61509]: X-User: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:12 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:08:12 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:08:12 user devstack@n-api.service[61509]: X-User-Id: b3b094a3cb97455395ffee8191d0644c Apr 20 15:08:12 user devstack@n-api.service[61509]: X-User-Name: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:12 user devstack@n-api.service[61509]: Apr 20 15:08:12 user devstack@n-api.service[61509]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1788728579", "metadata": {"Type": "work"}}} Apr 20 15:08:12 user devstack@n-api.service[61509]: method: Apr 20 15:08:12 user devstack@n-api.service[61509]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 15:08:12 user devstack@n-api.service[61509]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1788728579', 'metadata': {'Type': 'work'}}}} Apr 20 15:08:12 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise error Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi '' Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 15:08:12 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:08:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-686a10e3-a4f0-45be-a5eb-6dc1d9b3dc36 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:08:12 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-686a10e3-a4f0-45be-a5eb-6dc1d9b3dc36 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018288 Apr 20 15:08:12 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 15:08:12 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:08:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-799eb79a-a142-4f51-b5c9-961dedc042c4 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Calling method '.version_select at 0x7fcbb4eb5900>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:08:13 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-799eb79a-a142-4f51-b5c9-961dedc042c4 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] HTTP exception thrown: Volume tempest-invalid-173854546 could not be found. Apr 20 15:08:13 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-799eb79a-a142-4f51-b5c9-961dedc042c4 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Request method failure captured: Apr 20 15:08:13 user devstack@n-api.service[61508]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-173854546 HTTP/1.1 Apr 20 15:08:13 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:08:13 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:08:13 user devstack@n-api.service[61508]: Connection: close Apr 20 15:08:13 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:08:13 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:08:13 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:08:13 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:08:13 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVcLs53QiQzjA_nN75b4aCDzi6DecB2Mi0hFiaQpabZKY1in3Z3f0my5PcYwqT895d55WQ1h_mG54kRiaSkRTe2CmGnH364AAILWtcCmG8einK1F0q9bOD1xQ33xdAlafT-d7oki3O56kF7D07-z4L3EVSda8lMFgakS0-kLCQo7cw Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Project-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Project-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9157aeb0517b4958911951fa2a0e4a37"}]}] Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Tenant: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Tenant-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:13 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:13 user devstack@n-api.service[61508]: X-User: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:13 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:08:13 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:08:13 user devstack@n-api.service[61508]: X-User-Id: b3b094a3cb97455395ffee8191d0644c Apr 20 15:08:13 user devstack@n-api.service[61508]: X-User-Name: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:13 user devstack@n-api.service[61508]: method: Apr 20 15:08:13 user devstack@n-api.service[61508]: exception: Volume tempest-invalid-173854546 could not be found. Apr 20 15:08:13 user devstack@n-api.service[61508]: action_args: {'id': 'tempest-invalid-173854546'} Apr 20 15:08:13 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-173854546 could not be found. (HTTP 404) (Request-ID: req-d93908aa-9eb8-4fa8-b92d-e7bf933390c4) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-173854546 could not be found. Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-173854546 could not be found. Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-173854546 could not be found. Apr 20 15:08:13 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:13 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-799eb79a-a142-4f51-b5c9-961dedc042c4 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Returning 404 to user: Volume tempest-invalid-173854546 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:08:13 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-799eb79a-a142-4f51-b5c9-961dedc042c4 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-173854546" status: 404 len: 98 microversion: 2.1 time: 1.174841 Apr 20 15:08:13 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 20 15:08:12 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-173854546 => generated 98 bytes in 1176 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 20 15:08:13 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-7fca5cca-6351-4c9c-9e54-a86fe3a78a07 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003535 Apr 20 15:08:13 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 20 15:08:13 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 15:08:13 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-0c1dd318-4224-4fbd-9350-2ab8fcffeb35 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009499 Apr 20 15:08:13 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 20 15:08:13 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 15:08:13 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-c2c7a5e1-74fa-41c1-ab68-e46c61b78d4a tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Calling method '.version_select at 0x7fcbb435e3b0>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:08:14 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-c2c7a5e1-74fa-41c1-ab68-e46c61b78d4a tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] HTTP exception thrown: Volume bd139fe4-144e-475e-ba69-552cccee499c could not be found. Apr 20 15:08:14 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-c2c7a5e1-74fa-41c1-ab68-e46c61b78d4a tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Request method failure captured: Apr 20 15:08:14 user devstack@n-api.service[61508]: request: DELETE /compute/v2.1/os-volumes/bd139fe4-144e-475e-ba69-552cccee499c HTTP/1.1 Apr 20 15:08:14 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:08:14 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:08:14 user devstack@n-api.service[61508]: Connection: close Apr 20 15:08:14 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:08:14 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:08:14 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:08:14 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:08:14 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVcLs53QiQzjA_nN75b4aCDzi6DecB2Mi0hFiaQpabZKY1in3Z3f0my5PcYwqT895d55WQ1h_mG54kRiaSkRTe2CmGnH364AAILWtcCmG8einK1F0q9bOD1xQ33xdAlafT-d7oki3O56kF7D07-z4L3EVSda8lMFgakS0-kLCQo7cw Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Project-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Project-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9157aeb0517b4958911951fa2a0e4a37"}]}] Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Tenant: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Tenant-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:14 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:14 user devstack@n-api.service[61508]: X-User: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:14 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:08:14 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:08:14 user devstack@n-api.service[61508]: X-User-Id: b3b094a3cb97455395ffee8191d0644c Apr 20 15:08:14 user devstack@n-api.service[61508]: X-User-Name: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:14 user devstack@n-api.service[61508]: method: Apr 20 15:08:14 user devstack@n-api.service[61508]: exception: Volume bd139fe4-144e-475e-ba69-552cccee499c could not be found. Apr 20 15:08:14 user devstack@n-api.service[61508]: action_args: {'id': 'bd139fe4-144e-475e-ba69-552cccee499c'} Apr 20 15:08:14 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd139fe4-144e-475e-ba69-552cccee499c could not be found. (HTTP 404) (Request-ID: req-be4e71f2-e6b2-4736-8a23-67ca5a226480) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd139fe4-144e-475e-ba69-552cccee499c could not be found. Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd139fe4-144e-475e-ba69-552cccee499c could not be found. Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd139fe4-144e-475e-ba69-552cccee499c could not be found. Apr 20 15:08:14 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-c2c7a5e1-74fa-41c1-ab68-e46c61b78d4a tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Returning 404 to user: Volume bd139fe4-144e-475e-ba69-552cccee499c could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:08:14 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-c2c7a5e1-74fa-41c1-ab68-e46c61b78d4a tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/bd139fe4-144e-475e-ba69-552cccee499c" status: 404 len: 109 microversion: 2.1 time: 0.096628 Apr 20 15:08:14 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 15:08:13 2023] DELETE /compute/v2.1/os-volumes/bd139fe4-144e-475e-ba69-552cccee499c => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:08:14 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-5757c332-9f08-46f6-ac44-b47761e66b95 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Calling method '.version_select at 0x7fcbb4ed9870>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:08:14 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:08:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-5757c332-9f08-46f6-ac44-b47761e66b95 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] HTTP exception thrown: Volume f045c459-f591-429e-af48-ba970c5e4739 could not be found. Apr 20 15:08:14 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-5757c332-9f08-46f6-ac44-b47761e66b95 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Request method failure captured: Apr 20 15:08:14 user devstack@n-api.service[61510]: request: GET /compute/v2.1/os-volumes/f045c459-f591-429e-af48-ba970c5e4739 HTTP/1.1 Apr 20 15:08:14 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:08:14 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:08:14 user devstack@n-api.service[61510]: Connection: close Apr 20 15:08:14 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:08:14 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:08:14 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:08:14 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:08:14 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVVcLs53QiQzjA_nN75b4aCDzi6DecB2Mi0hFiaQpabZKY1in3Z3f0my5PcYwqT895d55WQ1h_mG54kRiaSkRTe2CmGnH364AAILWtcCmG8einK1F0q9bOD1xQ33xdAlafT-d7oki3O56kF7D07-z4L3EVSda8lMFgakS0-kLCQo7cw Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Project-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Project-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9157aeb0517b4958911951fa2a0e4a37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9157aeb0517b4958911951fa2a0e4a37"}]}] Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Tenant: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Tenant-Id: 9157aeb0517b4958911951fa2a0e4a37 Apr 20 15:08:14 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-VolumesNegativeTest-1377455462 Apr 20 15:08:14 user devstack@n-api.service[61510]: X-User: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:14 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:08:14 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:08:14 user devstack@n-api.service[61510]: X-User-Id: b3b094a3cb97455395ffee8191d0644c Apr 20 15:08:14 user devstack@n-api.service[61510]: X-User-Name: tempest-VolumesNegativeTest-1377455462-project-member Apr 20 15:08:14 user devstack@n-api.service[61510]: method: Apr 20 15:08:14 user devstack@n-api.service[61510]: exception: Volume f045c459-f591-429e-af48-ba970c5e4739 could not be found. Apr 20 15:08:14 user devstack@n-api.service[61510]: action_args: {'id': 'f045c459-f591-429e-af48-ba970c5e4739'} Apr 20 15:08:14 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f045c459-f591-429e-af48-ba970c5e4739 could not be found. (HTTP 404) (Request-ID: req-7d8cc92d-c109-46d1-a379-876c5a1c196f) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f045c459-f591-429e-af48-ba970c5e4739 could not be found. Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f045c459-f591-429e-af48-ba970c5e4739 could not be found. Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f045c459-f591-429e-af48-ba970c5e4739 could not be found. Apr 20 15:08:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:08:14 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-5757c332-9f08-46f6-ac44-b47761e66b95 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] Returning 404 to user: Volume f045c459-f591-429e-af48-ba970c5e4739 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:08:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-5757c332-9f08-46f6-ac44-b47761e66b95 tempest-VolumesNegativeTest-1377455462 tempest-VolumesNegativeTest-1377455462-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f045c459-f591-429e-af48-ba970c5e4739" status: 404 len: 109 microversion: 2.1 time: 0.144383 Apr 20 15:08:14 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 15:08:14 2023] GET /compute/v2.1/os-volumes/f045c459-f591-429e-af48-ba970c5e4739 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:08:31 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-49c4ef62-4fe0-4675-8d5a-3e9ed4b0c9b9 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Action: 'create', calling method: .version_select at 0x7fcbb45a9e10>, body: {"keypair": {"name": "tempest-keypair-453607784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJRcCXnxbv5d2zA23lH8z6qiEeZXca2lAplvx522jb3p7ITbD3XKKylPe1M+uKQwlSskgT83O1jHyufMWI5HxVeAvY+3l6RtnNYebQ+niYRzRESOhNo8WSpFbgSnX64Eg=="}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:32 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-49c4ef62-4fe0-4675-8d5a-3e9ed4b0c9b9 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Getting quotas for project 784602eedf114b789cbe062a0f4d8654. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:32 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-49c4ef62-4fe0-4675-8d5a-3e9ed4b0c9b9 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Getting quotas for user 29e0c347919c4f92bca310629130038c and project 784602eedf114b789cbe062a0f4d8654. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:32 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-49c4ef62-4fe0-4675-8d5a-3e9ed4b0c9b9 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.287026 Apr 20 15:08:32 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:08:31 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:33 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1274993174", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "networks": [{"uuid": "3626f883-4d6a-49ba-95ea-b76718169d69"}]}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:33 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-4a1935e3-120e-401a-a54e-e02fc8ad920f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Action: 'create', calling method: .version_select at 0x7fcbb4391240>, body: {"keypair": {"name": "tempest-keypair-847970234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCKt3RrMcvNa5jyxSzYHTCWOANTGtKKSNXXpUXyGD1eDmDLFCfiuKggd4vM0icvDWNX1/OcbWBO9GLmCZXEHnbEHJM3YvljiA5sH8jUUH6HkZmhCrIZ5G0GVpMZhOCfQA=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:33 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-4a1935e3-120e-401a-a54e-e02fc8ad920f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for project 5bb81196155147cea0569f8a96465b6a. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:33 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-4a1935e3-120e-401a-a54e-e02fc8ad920f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for user 8ca4ca64cede4846a74e2cc4c13f3c14 and project 5bb81196155147cea0569f8a96465b6a. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:33 user devstack@n-api.service[61508]: DEBUG nova.network.neutron [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] validate_networks() for [('3626f883-4d6a-49ba-95ea-b76718169d69', None, None, None, None, None)] {{(pid=61508) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:08:33 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-4a1935e3-120e-401a-a54e-e02fc8ad920f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.208327 Apr 20 15:08:33 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 20/55] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:08:33 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:35 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-fe670b76-fc21-4bd9-9aa3-5c6a1f9fbd5d tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Action: 'create', calling method: .version_select at 0x7fcbb435ee60>, body: {"keypair": {"name": "tempest-keypair-1226107213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqB24JZrTESYFgqsvT5RYUJObH4FsvCJosSo1OvnYZH4rOWSVsB68d4aZhW9vr6Tk8deFNHD3kJ7HId4lmO+nDBTSC/VBxPJHb8mwHxMDAbal1zhRWJ1ESUWZ0DkIqxyw=="}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:35 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-fe670b76-fc21-4bd9-9aa3-5c6a1f9fbd5d tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Getting quotas for project 606d9ee60abb40628f7e7d63e0275d63. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:35 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-fe670b76-fc21-4bd9-9aa3-5c6a1f9fbd5d tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Getting quotas for user 877cc3e810ea474fa06a22c17c5f0bd4 and project 606d9ee60abb40628f7e7d63e0275d63. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:35 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-fe670b76-fc21-4bd9-9aa3-5c6a1f9fbd5d tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.277813 Apr 20 15:08:35 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 19/56] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:08:35 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Flavor limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Image limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Flavor pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Image pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Getting quotas for project b53c73dfc9094d05802c05b2f25d6bed. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Getting quotas for user f19d8fcc1b69479992ff0d8bc5c99306 and project b53c73dfc9094d05802c05b2f25d6bed. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Going to run 1 instances... {{(pid=61508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:08:35 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 36c4e175-7373-4a71-85b1-2b6b56ed2d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:08:35 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-1fa6f8d3-80ba-4d6e-8800-6b13ca00529e tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.430602 Apr 20 15:08:35 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 18/57] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 15:08:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 2432 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 15:08:35 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-a2e57dbc-1db5-43ba-ae9f-a90994966dbd tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:08:35 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-a2e57dbc-1db5-43ba-ae9f-a90994966dbd tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 36c4e175-7373-4a71-85b1-2b6b56ed2d2b] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:08:35 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-a2e57dbc-1db5-43ba-ae9f-a90994966dbd tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:08:35 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-a2e57dbc-1db5-43ba-ae9f-a90994966dbd tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:08:35 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-a2e57dbc-1db5-43ba-ae9f-a90994966dbd tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:08:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-a2e57dbc-1db5-43ba-ae9f-a90994966dbd tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b" status: 200 len: 1395 microversion: 2.87 time: 0.298192 Apr 20 15:08:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 21/58] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:08:35 2023] GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b => generated 1395 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:08:37 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-525212983", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "networks": [{"uuid": "0d650f9c-f607-44de-a1a1-74ed3e2d131a"}]}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:38 user devstack@n-api.service[61509]: DEBUG nova.network.neutron [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] validate_networks() for [('0d650f9c-f607-44de-a1a1-74ed3e2d131a', None, None, None, None, None)] {{(pid=61509) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Flavor limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Image limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Flavor pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Image pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:39 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-2140023441", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "networks": [{"uuid": "6c36dfb9-a060-4661-a601-5be073ca975e"}], "security_groups": [{"name": "tempest-securitygroup--1661798184"}], "key_name": "tempest-keypair-453607784", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Getting quotas for project ce96c703059b46b2b8c6f08ac7fd6314. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Getting quotas for user e56e16e57c2d43dcafbf0c36a5669107 and project ce96c703059b46b2b8c6f08ac7fd6314. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Going to run 1 instances... {{(pid=61509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:08:39 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] [instance: 40d55224-364c-4989-b6ea-b8ce361d6895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:08:39 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-dbe258fa-8849-428f-90d6-3629e595bd8d tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.595320 Apr 20 15:08:39 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 20/59] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:08:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:08:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-19416d37-642b-45ce-899a-5c5537dd692a tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:08:39 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-19416d37-642b-45ce-899a-5c5537dd692a tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] [instance: 40d55224-364c-4989-b6ea-b8ce361d6895] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:08:39 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-19416d37-642b-45ce-899a-5c5537dd692a tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56e16e57c2d43dcafbf0c36a5669107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96c703059b46b2b8c6f08ac7fd6314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:08:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-19416d37-642b-45ce-899a-5c5537dd692a tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895" status: 200 len: 1208 microversion: 2.1 time: 0.249992 Apr 20 15:08:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 22/60] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:08:39 2023] GET /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895 => generated 1208 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:08:39 user devstack@n-api.service[61508]: DEBUG nova.network.neutron [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] validate_networks() for [('6c36dfb9-a060-4661-a601-5be073ca975e', None, None, None, None, None)] {{(pid=61508) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Flavor limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Image limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Flavor pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Image pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Getting quotas for project 784602eedf114b789cbe062a0f4d8654. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Getting quotas for user 29e0c347919c4f92bca310629130038c and project 784602eedf114b789cbe062a0f4d8654. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Going to run 1 instances... {{(pid=61508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:08:40 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:08:40 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-c7d3bbc7-f75d-4872-8925-960942544241 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.095005 Apr 20 15:08:40 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 19/61] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:08:39 2023] POST /compute/v2.1/servers => generated 404 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:08:40 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-0055f237-b4b8-4e48-ac2a-af4c3a319f41 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:08:40 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-0055f237-b4b8-4e48-ac2a-af4c3a319f41 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:08:40 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-0055f237-b4b8-4e48-ac2a-af4c3a319f41 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e0c347919c4f92bca310629130038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784602eedf114b789cbe062a0f4d8654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:08:40 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-0055f237-b4b8-4e48-ac2a-af4c3a319f41 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858" status: 200 len: 1239 microversion: 2.1 time: 0.117500 Apr 20 15:08:40 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 21/62] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:08:40 2023] GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858 => generated 1239 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:08:42 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-16896869", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "edb31b42-2f23-479e-8912-fbfd502dae97"}], "security_groups": [{"name": "tempest-securitygroup--825813675"}], "key_name": "tempest-keypair-847970234", "user_data": "}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:42 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] validate_networks() for [('edb31b42-2f23-479e-8912-fbfd502dae97', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-ea2fe4bf-d031-4113-9686-2061a5d80f0d req-e6182b6c-3d12-4075-ace4-8afe409487ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c4e175-7373-4a71-85b1-2b6b56ed2d2b", "tag": "c24699b2-379d-421e-9cda-e7c230f9778d"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ea2fe4bf-d031-4113-9686-2061a5d80f0d req-e6182b6c-3d12-4075-ace4-8afe409487ab service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ea2fe4bf-d031-4113-9686-2061a5d80f0d req-e6182b6c-3d12-4075-ace4-8afe409487ab service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ea2fe4bf-d031-4113-9686-2061a5d80f0d req-e6182b6c-3d12-4075-ace4-8afe409487ab service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:43 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-ea2fe4bf-d031-4113-9686-2061a5d80f0d req-e6182b6c-3d12-4075-ace4-8afe409487ab service nova] Creating event network-changed:c24699b2-379d-421e-9cda-e7c230f9778d for instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b on user Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ea2fe4bf-d031-4113-9686-2061a5d80f0d req-e6182b6c-3d12-4075-ace4-8afe409487ab service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61508) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ea2fe4bf-d031-4113-9686-2061a5d80f0d req-e6182b6c-3d12-4075-ace4-8afe409487ab service nova] Acquired lock "compute-rpcapi-router" {{(pid=61508) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c84166d9-ac10-46ef-9fd0-7752e982d8a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c84166d9-ac10-46ef-9fd0-7752e982d8a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c84166d9-ac10-46ef-9fd0-7752e982d8a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c84166d9-ac10-46ef-9fd0-7752e982d8a6 None None] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c84166d9-ac10-46ef-9fd0-7752e982d8a6 None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c84166d9-ac10-46ef-9fd0-7752e982d8a6 None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:43 user devstack@n-api.service[61508]: INFO nova.compute.rpcapi [None req-c84166d9-ac10-46ef-9fd0-7752e982d8a6 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 15:08:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c84166d9-ac10-46ef-9fd0-7752e982d8a6 None None] Releasing lock "compute-rpcapi-router" {{(pid=61508) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 15:08:43 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-c84166d9-ac10-46ef-9fd0-7752e982d8a6 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194285 Apr 20 15:08:43 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 20/63] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:08:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:43 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1676804716", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "95946961-b7dc-471f-a777-2e8da7f96eb1"}], "security_groups": [{"name": "tempest-securitygroup--1974721556"}], "key_name": "tempest-keypair-1226107213", "user_data": "}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for project 5bb81196155147cea0569f8a96465b6a. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for user 8ca4ca64cede4846a74e2cc4c13f3c14 and project 5bb81196155147cea0569f8a96465b6a. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:44 user devstack@n-api.service[61509]: DEBUG nova.network.neutron [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] validate_networks() for [('95946961-b7dc-471f-a777-2e8da7f96eb1', None, None, None, None, None)] {{(pid=61509) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:08:44 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:08:44 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-01909a7b-a32c-45c6-a460-2911fb1bce3c tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.071655 Apr 20 15:08:44 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 23/64] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:08:42 2023] POST /compute/v2.1/servers => generated 399 bytes in 2075 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:08:44 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-b87e4175-f0d2-4f3c-8b54-82b8a0b4b8cf tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:08:44 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-b87e4175-f0d2-4f3c-8b54-82b8a0b4b8cf tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:08:44 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-b87e4175-f0d2-4f3c-8b54-82b8a0b4b8cf tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca4ca64cede4846a74e2cc4c13f3c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb81196155147cea0569f8a96465b6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:08:44 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-b87e4175-f0d2-4f3c-8b54-82b8a0b4b8cf tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79" status: 200 len: 1233 microversion: 2.1 time: 0.231622 Apr 20 15:08:44 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 21/65] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:08:44 2023] GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79 => generated 1233 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Flavor limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Image limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Flavor pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Image pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Getting quotas for project 606d9ee60abb40628f7e7d63e0275d63. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Getting quotas for user 877cc3e810ea474fa06a22c17c5f0bd4 and project 606d9ee60abb40628f7e7d63e0275d63. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Going to run 1 instances... {{(pid=61509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:08:46 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:08:46 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-4f1963b8-bbad-4217-9705-baa5c234dfa8 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.071093 Apr 20 15:08:46 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 22/66] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:08:43 2023] POST /compute/v2.1/servers => generated 407 bytes in 3078 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:08:46 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-beb97b10-fdf3-4962-a391-8a0db829cb53 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:08:46 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-beb97b10-fdf3-4962-a391-8a0db829cb53 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:08:47 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-beb97b10-fdf3-4962-a391-8a0db829cb53 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:08:47 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-beb97b10-fdf3-4962-a391-8a0db829cb53 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1233 microversion: 2.1 time: 0.170132 Apr 20 15:08:47 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 24/67] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:08:46 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1233 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:08:47 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-2bf80a20-4bdf-4cfa-b7de-182941284147 req-96b585de-5034-4fb4-853b-d996c271608b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d55224-364c-4989-b6ea-b8ce361d6895", "tag": "b1ca5c7b-c4a5-47b8-b419-c873aea9c510"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:47 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-2bf80a20-4bdf-4cfa-b7de-182941284147 req-96b585de-5034-4fb4-853b-d996c271608b service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:47 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-2bf80a20-4bdf-4cfa-b7de-182941284147 req-96b585de-5034-4fb4-853b-d996c271608b service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:47 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-2bf80a20-4bdf-4cfa-b7de-182941284147 req-96b585de-5034-4fb4-853b-d996c271608b service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:47 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-2bf80a20-4bdf-4cfa-b7de-182941284147 req-96b585de-5034-4fb4-853b-d996c271608b service nova] Creating event network-changed:b1ca5c7b-c4a5-47b8-b419-c873aea9c510 for instance 40d55224-364c-4989-b6ea-b8ce361d6895 on user Apr 20 15:08:47 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-2bf80a20-4bdf-4cfa-b7de-182941284147 req-96b585de-5034-4fb4-853b-d996c271608b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301201 Apr 20 15:08:47 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 22/68] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:08:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:49 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-9c50ffe0-7f7e-47bf-92a1-ffef506e5c9b tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Action: 'create', calling method: .version_select at 0x7fcbb4387ac0>, body: {"keypair": {"name": "tempest-keypair-1824375720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt6kNMNo7FsBv508WE/y5S7oaB8JD5s6w/HW9ZM4eJ4VUPRt/QiLDdIMH6sEkU6VicqlmvAl2PpwuwB85NU5sWD1/PbUTkblHF4WQ4Ti9uULY1BGHaSRfOuHgkzx5KkXw=="}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:49 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-9c50ffe0-7f7e-47bf-92a1-ffef506e5c9b tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Getting quotas for project baaed885af6443a2b5d13ece323b669a. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:49 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-9c50ffe0-7f7e-47bf-92a1-ffef506e5c9b tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Getting quotas for user bd9585e756e6464da77a49905348b36a and project baaed885af6443a2b5d13ece323b669a. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:49 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-9c50ffe0-7f7e-47bf-92a1-ffef506e5c9b tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.398666 Apr 20 15:08:49 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 23/69] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:08:49 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:49 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-3df47074-49a7-454b-b851-8f3e3185cbbf req-c86f05bb-12a8-4c78-9684-ad9991646bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43cea1ab-3ddc-401d-97b3-3721808e2858", "tag": "a371311c-f46e-4115-9490-5fb33d90dcd4"}, {"server_uuid": "36c4e175-7373-4a71-85b1-2b6b56ed2d2b", "name": "network-vif-plugged", "status": "completed", "tag": "c24699b2-379d-421e-9cda-e7c230f9778d"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-3df47074-49a7-454b-b851-8f3e3185cbbf req-c86f05bb-12a8-4c78-9684-ad9991646bdf service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-3df47074-49a7-454b-b851-8f3e3185cbbf req-c86f05bb-12a8-4c78-9684-ad9991646bdf service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-3df47074-49a7-454b-b851-8f3e3185cbbf req-c86f05bb-12a8-4c78-9684-ad9991646bdf service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-0012859a-6305-4c4c-a518-39a6ef5a07f1 req-efd356d9-8c3a-48ef-9bb2-95bbe9f70431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f6bf8b-960a-462d-9a05-05f7e4f42f79", "tag": "b01baa05-fe60-4fd6-bff7-359f238cf891"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:49 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-3df47074-49a7-454b-b851-8f3e3185cbbf req-c86f05bb-12a8-4c78-9684-ad9991646bdf service nova] Creating event network-changed:a371311c-f46e-4115-9490-5fb33d90dcd4 for instance 43cea1ab-3ddc-401d-97b3-3721808e2858 on user Apr 20 15:08:49 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-3df47074-49a7-454b-b851-8f3e3185cbbf req-c86f05bb-12a8-4c78-9684-ad9991646bdf service nova] Creating event network-vif-plugged:c24699b2-379d-421e-9cda-e7c230f9778d for instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b on user Apr 20 15:08:49 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-3df47074-49a7-454b-b851-8f3e3185cbbf req-c86f05bb-12a8-4c78-9684-ad9991646bdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.079209 Apr 20 15:08:49 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 23/70] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:08:49 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-0012859a-6305-4c4c-a518-39a6ef5a07f1 req-efd356d9-8c3a-48ef-9bb2-95bbe9f70431 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-0012859a-6305-4c4c-a518-39a6ef5a07f1 req-efd356d9-8c3a-48ef-9bb2-95bbe9f70431 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-0012859a-6305-4c4c-a518-39a6ef5a07f1 req-efd356d9-8c3a-48ef-9bb2-95bbe9f70431 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:49 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-0012859a-6305-4c4c-a518-39a6ef5a07f1 req-efd356d9-8c3a-48ef-9bb2-95bbe9f70431 service nova] Creating event network-changed:b01baa05-fe60-4fd6-bff7-359f238cf891 for instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 on user Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-0012859a-6305-4c4c-a518-39a6ef5a07f1 req-efd356d9-8c3a-48ef-9bb2-95bbe9f70431 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61510) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-0012859a-6305-4c4c-a518-39a6ef5a07f1 req-efd356d9-8c3a-48ef-9bb2-95bbe9f70431 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61510) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9701e54d-4c2c-41fb-a081-e6c4886b783a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9701e54d-4c2c-41fb-a081-e6c4886b783a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9701e54d-4c2c-41fb-a081-e6c4886b783a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9701e54d-4c2c-41fb-a081-e6c4886b783a None None] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9701e54d-4c2c-41fb-a081-e6c4886b783a None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9701e54d-4c2c-41fb-a081-e6c4886b783a None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:49 user devstack@n-api.service[61510]: INFO nova.compute.rpcapi [None req-9701e54d-4c2c-41fb-a081-e6c4886b783a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 15:08:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9701e54d-4c2c-41fb-a081-e6c4886b783a None None] Releasing lock "compute-rpcapi-router" {{(pid=61510) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 15:08:49 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-9701e54d-4c2c-41fb-a081-e6c4886b783a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.312001 Apr 20 15:08:49 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 25/71] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:08:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:51 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-ef9ecbb0-8465-406e-bc33-f5144421bced tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Action: 'create', calling method: .version_select at 0x7fcbb4231990>, body: {"keypair": {"name": "tempest-keypair-1917611531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmcFkz9eMHwDnMNa+m7BuQcaQhW3dpxqIBDU7c/9JBRUdMxa4jEtpD5hpRV6jSYc8XFBFJvgnolmQecVAlxJh/2KszNHDDhkuUqx3Hgiqp8vsoJXxO+7wILBCtJZJjrdQ=="}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:51 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-ef9ecbb0-8465-406e-bc33-f5144421bced tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Getting quotas for project d37fba0ede194eb6998df9fa7230906c. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:51 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-ef9ecbb0-8465-406e-bc33-f5144421bced tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Getting quotas for user f284743e682b48cbb1f0a4090b4c6ba3 and project d37fba0ede194eb6998df9fa7230906c. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:51 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-ef9ecbb0-8465-406e-bc33-f5144421bced tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.315322 Apr 20 15:08:51 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 24/72] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:08:50 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:51 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-cff048c4-9b86-4439-8d67-89cd77527168 req-5ee4c41e-5e8d-49d5-a6a5-ae177e0cbc80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4e175-7373-4a71-85b1-2b6b56ed2d2b", "name": "network-vif-plugged", "status": "completed", "tag": "c24699b2-379d-421e-9cda-e7c230f9778d"}, {"server_uuid": "40d55224-364c-4989-b6ea-b8ce361d6895", "name": "network-vif-plugged", "status": "completed", "tag": "b1ca5c7b-c4a5-47b8-b419-c873aea9c510"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:51 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-cff048c4-9b86-4439-8d67-89cd77527168 req-5ee4c41e-5e8d-49d5-a6a5-ae177e0cbc80 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:51 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-cff048c4-9b86-4439-8d67-89cd77527168 req-5ee4c41e-5e8d-49d5-a6a5-ae177e0cbc80 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:51 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-cff048c4-9b86-4439-8d67-89cd77527168 req-5ee4c41e-5e8d-49d5-a6a5-ae177e0cbc80 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:51 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-cff048c4-9b86-4439-8d67-89cd77527168 req-5ee4c41e-5e8d-49d5-a6a5-ae177e0cbc80 service nova] Creating event network-vif-plugged:c24699b2-379d-421e-9cda-e7c230f9778d for instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b on user Apr 20 15:08:51 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-cff048c4-9b86-4439-8d67-89cd77527168 req-5ee4c41e-5e8d-49d5-a6a5-ae177e0cbc80 service nova] Creating event network-vif-plugged:b1ca5c7b-c4a5-47b8-b419-c873aea9c510 for instance 40d55224-364c-4989-b6ea-b8ce361d6895 on user Apr 20 15:08:51 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-cff048c4-9b86-4439-8d67-89cd77527168 req-5ee4c41e-5e8d-49d5-a6a5-ae177e0cbc80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057733 Apr 20 15:08:51 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:08:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:53 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-6bfa72b6-4e7d-4561-b607-3dd810175d9c req-4a6e7425-ece0-4e75-8435-4286d5ea426d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d55224-364c-4989-b6ea-b8ce361d6895", "name": "network-vif-plugged", "status": "completed", "tag": "b1ca5c7b-c4a5-47b8-b419-c873aea9c510"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-6bfa72b6-4e7d-4561-b607-3dd810175d9c req-4a6e7425-ece0-4e75-8435-4286d5ea426d service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-6bfa72b6-4e7d-4561-b607-3dd810175d9c req-4a6e7425-ece0-4e75-8435-4286d5ea426d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-6bfa72b6-4e7d-4561-b607-3dd810175d9c req-4a6e7425-ece0-4e75-8435-4286d5ea426d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:54 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-6bfa72b6-4e7d-4561-b607-3dd810175d9c req-4a6e7425-ece0-4e75-8435-4286d5ea426d service nova] Creating event network-vif-plugged:b1ca5c7b-c4a5-47b8-b419-c873aea9c510 for instance 40d55224-364c-4989-b6ea-b8ce361d6895 on user Apr 20 15:08:54 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-6bfa72b6-4e7d-4561-b607-3dd810175d9c req-4a6e7425-ece0-4e75-8435-4286d5ea426d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093219 Apr 20 15:08:54 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 26/74] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:08:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-03ab099e-1748-4449-8bda-8d0b97ba6f9b req-058d458f-728b-4442-b0cc-a9d8f1e4cf63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f6bf8b-960a-462d-9a05-05f7e4f42f79", "name": "network-vif-plugged", "status": "completed", "tag": "b01baa05-fe60-4fd6-bff7-359f238cf891"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-03ab099e-1748-4449-8bda-8d0b97ba6f9b req-058d458f-728b-4442-b0cc-a9d8f1e4cf63 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-03ab099e-1748-4449-8bda-8d0b97ba6f9b req-058d458f-728b-4442-b0cc-a9d8f1e4cf63 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-03ab099e-1748-4449-8bda-8d0b97ba6f9b req-058d458f-728b-4442-b0cc-a9d8f1e4cf63 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:54 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-03ab099e-1748-4449-8bda-8d0b97ba6f9b req-058d458f-728b-4442-b0cc-a9d8f1e4cf63 service nova] Creating event network-vif-plugged:b01baa05-fe60-4fd6-bff7-359f238cf891 for instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 on user Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-03ab099e-1748-4449-8bda-8d0b97ba6f9b req-058d458f-728b-4442-b0cc-a9d8f1e4cf63 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-03ab099e-1748-4449-8bda-8d0b97ba6f9b req-058d458f-728b-4442-b0cc-a9d8f1e4cf63 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-43a21028-9856-4eef-8025-f3de5a9e54dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-43a21028-9856-4eef-8025-f3de5a9e54dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-43a21028-9856-4eef-8025-f3de5a9e54dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-43a21028-9856-4eef-8025-f3de5a9e54dc None None] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-43a21028-9856-4eef-8025-f3de5a9e54dc None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-43a21028-9856-4eef-8025-f3de5a9e54dc None None] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:54 user devstack@n-api.service[61509]: INFO nova.compute.rpcapi [None req-43a21028-9856-4eef-8025-f3de5a9e54dc None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 15:08:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-43a21028-9856-4eef-8025-f3de5a9e54dc None None] Releasing lock "compute-rpcapi-router" {{(pid=61509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 15:08:54 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-43a21028-9856-4eef-8025-f3de5a9e54dc None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112988 Apr 20 15:08:54 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:08:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:56 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:08:56 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=14 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:08:56 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-80c3842a-3a14-414c-bf56-3ce39b590047 req-88f042da-e581-4e3e-881a-73ddca5eef8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bb81fa0-7c0d-4144-bce4-fc9053c94e8e", "tag": "893ef125-a4b8-4206-8d2f-d01891c151b8"}, {"server_uuid": "88f6bf8b-960a-462d-9a05-05f7e4f42f79", "name": "network-vif-plugged", "status": "completed", "tag": "b01baa05-fe60-4fd6-bff7-359f238cf891"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:56 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1392367153", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "networks": [{"uuid": "ae89b425-8bb9-48b2-9ff0-6a977cda42ec"}], "security_groups": [{"name": "tempest-securitygroup--1953566374"}], "key_name": "tempest-keypair-1824375720", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:56 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-80c3842a-3a14-414c-bf56-3ce39b590047 req-88f042da-e581-4e3e-881a-73ddca5eef8f service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:56 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-80c3842a-3a14-414c-bf56-3ce39b590047 req-88f042da-e581-4e3e-881a-73ddca5eef8f service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:56 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-80c3842a-3a14-414c-bf56-3ce39b590047 req-88f042da-e581-4e3e-881a-73ddca5eef8f service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:56 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-80c3842a-3a14-414c-bf56-3ce39b590047 req-88f042da-e581-4e3e-881a-73ddca5eef8f service nova] Creating event network-changed:893ef125-a4b8-4206-8d2f-d01891c151b8 for instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e on user Apr 20 15:08:56 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-80c3842a-3a14-414c-bf56-3ce39b590047 req-88f042da-e581-4e3e-881a-73ddca5eef8f service nova] Creating event network-vif-plugged:b01baa05-fe60-4fd6-bff7-359f238cf891 for instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 on user Apr 20 15:08:56 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-80c3842a-3a14-414c-bf56-3ce39b590047 req-88f042da-e581-4e3e-881a-73ddca5eef8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.074739 Apr 20 15:08:56 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:08:56 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:56 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] validate_networks() for [('ae89b425-8bb9-48b2-9ff0-6a977cda42ec', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=16 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:08:57 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-362520986", "imageRef": "65dfa104-c352-4de0-8abb-0bb5beb0c739", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "0cb75e58-5659-46ee-ab00-5774f4b764df"}], "security_groups": [{"name": "tempest-securitygroup--474525762"}], "key_name": "tempest-keypair-1917611531", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:58 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Getting quotas for project baaed885af6443a2b5d13ece323b669a. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:58 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Getting quotas for user bd9585e756e6464da77a49905348b36a and project baaed885af6443a2b5d13ece323b669a. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:58 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:08:58 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: aa981382-1b12-48d6-8661-0ddf1586a9af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:08:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-795dd8d6-6bd8-4436-a086-ef45bf6e65fa tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.654251 Apr 20 15:08:58 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 27/77] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:08:56 2023] POST /compute/v2.1/servers => generated 404 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:08:58 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-988e00a6-c416-49a4-a7a9-8b92224b0fb6 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:08:58 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-988e00a6-c416-49a4-a7a9-8b92224b0fb6 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: aa981382-1b12-48d6-8661-0ddf1586a9af] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:08:58 user devstack@n-api.service[61509]: DEBUG nova.network.neutron [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] validate_networks() for [('0cb75e58-5659-46ee-ab00-5774f4b764df', None, None, None, None, None)] {{(pid=61509) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:08:58 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-988e00a6-c416-49a4-a7a9-8b92224b0fb6 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9585e756e6464da77a49905348b36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaed885af6443a2b5d13ece323b669a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:08:58 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-988e00a6-c416-49a4-a7a9-8b92224b0fb6 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af" status: 200 len: 1236 microversion: 2.1 time: 0.225585 Apr 20 15:08:58 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 26/78] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:08:58 2023] GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af => generated 1236 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:08:58 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-e3a9d3c5-ab41-4ead-8028-dcbd6dec35dd req-d62557bb-55ca-4a82-9a15-9616290e4fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43cea1ab-3ddc-401d-97b3-3721808e2858", "name": "network-vif-plugged", "status": "completed", "tag": "a371311c-f46e-4115-9490-5fb33d90dcd4"}, {"server_uuid": "43cea1ab-3ddc-401d-97b3-3721808e2858", "name": "network-vif-plugged", "status": "completed", "tag": "a371311c-f46e-4115-9490-5fb33d90dcd4"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:08:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e3a9d3c5-ab41-4ead-8028-dcbd6dec35dd req-d62557bb-55ca-4a82-9a15-9616290e4fdf service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e3a9d3c5-ab41-4ead-8028-dcbd6dec35dd req-d62557bb-55ca-4a82-9a15-9616290e4fdf service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e3a9d3c5-ab41-4ead-8028-dcbd6dec35dd req-d62557bb-55ca-4a82-9a15-9616290e4fdf service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-e3a9d3c5-ab41-4ead-8028-dcbd6dec35dd req-d62557bb-55ca-4a82-9a15-9616290e4fdf service nova] Creating event network-vif-plugged:a371311c-f46e-4115-9490-5fb33d90dcd4 for instance 43cea1ab-3ddc-401d-97b3-3721808e2858 on user Apr 20 15:08:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-e3a9d3c5-ab41-4ead-8028-dcbd6dec35dd req-d62557bb-55ca-4a82-9a15-9616290e4fdf service nova] Creating event network-vif-plugged:a371311c-f46e-4115-9490-5fb33d90dcd4 for instance 43cea1ab-3ddc-401d-97b3-3721808e2858 on user Apr 20 15:08:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-e3a9d3c5-ab41-4ead-8028-dcbd6dec35dd req-d62557bb-55ca-4a82-9a15-9616290e4fdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070652 Apr 20 15:08:58 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 28/79] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:08:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Flavor limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Image limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Flavor pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Image pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Getting quotas for project d37fba0ede194eb6998df9fa7230906c. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Getting quotas for user f284743e682b48cbb1f0a4090b4c6ba3 and project d37fba0ede194eb6998df9fa7230906c. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Going to run 1 instances... {{(pid=61509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:08:59 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] [instance: 22660afa-9082-40e8-9293-82048b1ae755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65dfa104-c352-4de0-8abb-0bb5beb0c739',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:08:59 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-a31fc11b-5e3a-46ed-9986-a95323208c65 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.899207 Apr 20 15:08:59 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 26/80] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:08:57 2023] POST /compute/v2.1/servers => generated 403 bytes in 1906 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:08:59 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-a916920f-266d-4ae4-9aa5-73d4c575dfae tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:08:59 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-a916920f-266d-4ae4-9aa5-73d4c575dfae tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] [instance: 22660afa-9082-40e8-9293-82048b1ae755] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:08:59 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-a916920f-266d-4ae4-9aa5-73d4c575dfae tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284743e682b48cbb1f0a4090b4c6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37fba0ede194eb6998df9fa7230906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:08:59 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-a916920f-266d-4ae4-9aa5-73d4c575dfae tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755" status: 200 len: 1239 microversion: 2.1 time: 0.206679 Apr 20 15:08:59 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 27/81] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:08:59 2023] GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755 => generated 1239 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:09:00 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-1a9c2b31-fd0d-4a97-ac79-1bb9d479383e req-0243f77f-e265-4031-9858-91aa43b1f67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb81fa0-7c0d-4144-bce4-fc9053c94e8e", "name": "network-vif-plugged", "status": "completed", "tag": "893ef125-a4b8-4206-8d2f-d01891c151b8"}, {"server_uuid": "8bb81fa0-7c0d-4144-bce4-fc9053c94e8e", "name": "network-vif-plugged", "status": "completed", "tag": "893ef125-a4b8-4206-8d2f-d01891c151b8"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-1a9c2b31-fd0d-4a97-ac79-1bb9d479383e req-0243f77f-e265-4031-9858-91aa43b1f67c service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-1a9c2b31-fd0d-4a97-ac79-1bb9d479383e req-0243f77f-e265-4031-9858-91aa43b1f67c service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-1a9c2b31-fd0d-4a97-ac79-1bb9d479383e req-0243f77f-e265-4031-9858-91aa43b1f67c service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:00 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-1a9c2b31-fd0d-4a97-ac79-1bb9d479383e req-0243f77f-e265-4031-9858-91aa43b1f67c service nova] Creating event network-vif-plugged:893ef125-a4b8-4206-8d2f-d01891c151b8 for instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e on user Apr 20 15:09:00 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-1a9c2b31-fd0d-4a97-ac79-1bb9d479383e req-0243f77f-e265-4031-9858-91aa43b1f67c service nova] Creating event network-vif-plugged:893ef125-a4b8-4206-8d2f-d01891c151b8 for instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e on user Apr 20 15:09:00 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-1a9c2b31-fd0d-4a97-ac79-1bb9d479383e req-0243f77f-e265-4031-9858-91aa43b1f67c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093995 Apr 20 15:09:00 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 29/82] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:09:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:05 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-e22950b8-491d-4184-8feb-8609010f6d52 req-56d9adb3-49f2-492e-a097-eb56787a17c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa981382-1b12-48d6-8661-0ddf1586a9af", "tag": "af567b84-ebb0-479c-b788-240ef47450eb"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:05 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e22950b8-491d-4184-8feb-8609010f6d52 req-56d9adb3-49f2-492e-a097-eb56787a17c9 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:05 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e22950b8-491d-4184-8feb-8609010f6d52 req-56d9adb3-49f2-492e-a097-eb56787a17c9 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:05 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e22950b8-491d-4184-8feb-8609010f6d52 req-56d9adb3-49f2-492e-a097-eb56787a17c9 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:05 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=11 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:05 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-e22950b8-491d-4184-8feb-8609010f6d52 req-56d9adb3-49f2-492e-a097-eb56787a17c9 service nova] Creating event network-changed:af567b84-ebb0-479c-b788-240ef47450eb for instance aa981382-1b12-48d6-8661-0ddf1586a9af on user Apr 20 15:09:05 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-e22950b8-491d-4184-8feb-8609010f6d52 req-56d9adb3-49f2-492e-a097-eb56787a17c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042640 Apr 20 15:09:05 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 27/83] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:09:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 15:09:06 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-419d4fee-dd69-42c3-a37e-be03474dd9ae req-dd7ab2a0-787b-430f-9d0d-ac321247834a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22660afa-9082-40e8-9293-82048b1ae755", "tag": "7dc2c082-a1a1-4af2-8251-29710d798847"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:06 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=16 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:06 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:06 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-419d4fee-dd69-42c3-a37e-be03474dd9ae req-dd7ab2a0-787b-430f-9d0d-ac321247834a service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:06 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-419d4fee-dd69-42c3-a37e-be03474dd9ae req-dd7ab2a0-787b-430f-9d0d-ac321247834a service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:06 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-419d4fee-dd69-42c3-a37e-be03474dd9ae req-dd7ab2a0-787b-430f-9d0d-ac321247834a service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:06 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-419d4fee-dd69-42c3-a37e-be03474dd9ae req-dd7ab2a0-787b-430f-9d0d-ac321247834a service nova] Creating event network-changed:7dc2c082-a1a1-4af2-8251-29710d798847 for instance 22660afa-9082-40e8-9293-82048b1ae755 on user Apr 20 15:09:06 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-419d4fee-dd69-42c3-a37e-be03474dd9ae req-dd7ab2a0-787b-430f-9d0d-ac321247834a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040396 Apr 20 15:09:06 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:09:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:08 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:08 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:08 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-a6db2680-587f-43ad-adb3-97c1b5daf72f req-b1750775-1b4a-4e96-adca-1d75dafb9163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa981382-1b12-48d6-8661-0ddf1586a9af", "name": "network-vif-plugged", "status": "completed", "tag": "af567b84-ebb0-479c-b788-240ef47450eb"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:08 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-a6db2680-587f-43ad-adb3-97c1b5daf72f req-b1750775-1b4a-4e96-adca-1d75dafb9163 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-a6db2680-587f-43ad-adb3-97c1b5daf72f req-b1750775-1b4a-4e96-adca-1d75dafb9163 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-a6db2680-587f-43ad-adb3-97c1b5daf72f req-b1750775-1b4a-4e96-adca-1d75dafb9163 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:09 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-a6db2680-587f-43ad-adb3-97c1b5daf72f req-b1750775-1b4a-4e96-adca-1d75dafb9163 service nova] Creating event network-vif-plugged:af567b84-ebb0-479c-b788-240ef47450eb for instance aa981382-1b12-48d6-8661-0ddf1586a9af on user Apr 20 15:09:09 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-a6db2680-587f-43ad-adb3-97c1b5daf72f req-b1750775-1b4a-4e96-adca-1d75dafb9163 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057782 Apr 20 15:09:09 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 30/85] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:09:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:10 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=8 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:10 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=36 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:10 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-51a642f9-66c1-4a8d-b002-b8e45bd62d9f req-6243b1ec-4e1b-46ce-b4e0-3bc68a8d19f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22660afa-9082-40e8-9293-82048b1ae755", "name": "network-vif-plugged", "status": "completed", "tag": "7dc2c082-a1a1-4af2-8251-29710d798847"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-51a642f9-66c1-4a8d-b002-b8e45bd62d9f req-6243b1ec-4e1b-46ce-b4e0-3bc68a8d19f4 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-51a642f9-66c1-4a8d-b002-b8e45bd62d9f req-6243b1ec-4e1b-46ce-b4e0-3bc68a8d19f4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-51a642f9-66c1-4a8d-b002-b8e45bd62d9f req-6243b1ec-4e1b-46ce-b4e0-3bc68a8d19f4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:11 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-51a642f9-66c1-4a8d-b002-b8e45bd62d9f req-6243b1ec-4e1b-46ce-b4e0-3bc68a8d19f4 service nova] Creating event network-vif-plugged:7dc2c082-a1a1-4af2-8251-29710d798847 for instance 22660afa-9082-40e8-9293-82048b1ae755 on user Apr 20 15:09:11 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-51a642f9-66c1-4a8d-b002-b8e45bd62d9f req-6243b1ec-4e1b-46ce-b4e0-3bc68a8d19f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059741 Apr 20 15:09:11 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 28/86] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:09:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:11 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:11 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-c8141e49-a932-45d3-8550-89080453b280 req-ba3c087b-96ca-4218-8773-6bc9d03588cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa981382-1b12-48d6-8661-0ddf1586a9af", "name": "network-vif-plugged", "status": "completed", "tag": "af567b84-ebb0-479c-b788-240ef47450eb"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:11 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-c8141e49-a932-45d3-8550-89080453b280 req-ba3c087b-96ca-4218-8773-6bc9d03588cb service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:11 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-c8141e49-a932-45d3-8550-89080453b280 req-ba3c087b-96ca-4218-8773-6bc9d03588cb service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:11 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-c8141e49-a932-45d3-8550-89080453b280 req-ba3c087b-96ca-4218-8773-6bc9d03588cb service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:11 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-c8141e49-a932-45d3-8550-89080453b280 req-ba3c087b-96ca-4218-8773-6bc9d03588cb service nova] Creating event network-vif-plugged:af567b84-ebb0-479c-b788-240ef47450eb for instance aa981382-1b12-48d6-8661-0ddf1586a9af on user Apr 20 15:09:11 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-c8141e49-a932-45d3-8550-89080453b280 req-ba3c087b-96ca-4218-8773-6bc9d03588cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041140 Apr 20 15:09:11 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 29/87] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:13 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-59af204d-d34d-4a27-8a7f-c94d28d37cbc req-9f6f7138-5f5b-4f33-ada6-1d50f189b9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22660afa-9082-40e8-9293-82048b1ae755", "name": "network-vif-plugged", "status": "completed", "tag": "7dc2c082-a1a1-4af2-8251-29710d798847"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-59af204d-d34d-4a27-8a7f-c94d28d37cbc req-9f6f7138-5f5b-4f33-ada6-1d50f189b9a6 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-59af204d-d34d-4a27-8a7f-c94d28d37cbc req-9f6f7138-5f5b-4f33-ada6-1d50f189b9a6 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-59af204d-d34d-4a27-8a7f-c94d28d37cbc req-9f6f7138-5f5b-4f33-ada6-1d50f189b9a6 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:13 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-59af204d-d34d-4a27-8a7f-c94d28d37cbc req-9f6f7138-5f5b-4f33-ada6-1d50f189b9a6 service nova] Creating event network-vif-plugged:7dc2c082-a1a1-4af2-8251-29710d798847 for instance 22660afa-9082-40e8-9293-82048b1ae755 on user Apr 20 15:09:13 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-59af204d-d34d-4a27-8a7f-c94d28d37cbc req-9f6f7138-5f5b-4f33-ada6-1d50f189b9a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034146 Apr 20 15:09:13 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 31/88] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:09:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:15 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-9d4d7857-7b87-4997-9dc2-bc727e60d5e6 tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] Action: 'create', calling method: .version_select at 0x7fcbb4233640>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-304219893", "metadata": {"Type": "work"}}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:16 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-9d4d7857-7b87-4997-9dc2-bc727e60d5e6 tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.683343 Apr 20 15:09:16 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 29/89] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 15:09:15 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 685 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 15:09:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-d70c3b06-2d07-40f7-ad68-085022b3578f tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] Calling method '.version_select at 0x7fcbb42e72e0>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:16 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-d70c3b06-2d07-40f7-ad68-085022b3578f tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/562035dd-cf71-4fc6-88f5-46e4809dff89" status: 200 len: 349 microversion: 2.1 time: 0.081257 Apr 20 15:09:16 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 30/90] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 15:09:16 2023] GET /compute/v2.1/os-volumes/562035dd-cf71-4fc6-88f5-46e4809dff89 => generated 349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 15:09:17 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-7b3508b3-24df-4506-b5b5-00b0243d9b5f tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] Calling method '.version_select at 0x7fcbb42fa200>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:17 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-7b3508b3-24df-4506-b5b5-00b0243d9b5f tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/562035dd-cf71-4fc6-88f5-46e4809dff89" status: 200 len: 349 microversion: 2.1 time: 0.067462 Apr 20 15:09:17 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 32/91] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 15:09:17 2023] GET /compute/v2.1/os-volumes/562035dd-cf71-4fc6-88f5-46e4809dff89 => generated 349 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:17 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-a17cd4e9-4e2d-47d7-aa10-b925bca8fc39 tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] Calling method '.version_select at 0x7fcbb42ccc10>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:17 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-a17cd4e9-4e2d-47d7-aa10-b925bca8fc39 tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/562035dd-cf71-4fc6-88f5-46e4809dff89" status: 202 len: 0 microversion: 2.1 time: 0.152982 Apr 20 15:09:17 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 30/92] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 15:09:17 2023] DELETE /compute/v2.1/os-volumes/562035dd-cf71-4fc6-88f5-46e4809dff89 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:09:17 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-27231662-6b44-4efe-85a9-a0846d1beaac tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] Calling method '.version_select at 0x7fcbb42e77f0>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:17 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-27231662-6b44-4efe-85a9-a0846d1beaac tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] HTTP exception thrown: Volume 562035dd-cf71-4fc6-88f5-46e4809dff89 could not be found. Apr 20 15:09:17 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-27231662-6b44-4efe-85a9-a0846d1beaac tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] Request method failure captured: Apr 20 15:09:17 user devstack@n-api.service[61508]: request: GET /compute/v2.1/os-volumes/562035dd-cf71-4fc6-88f5-46e4809dff89 HTTP/1.1 Apr 20 15:09:17 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:09:17 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:09:17 user devstack@n-api.service[61508]: Connection: close Apr 20 15:09:17 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:09:17 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:09:17 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:09:17 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:09:17 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVWbUhIE81PDMDsquKhLDFI2i9HlSRJYHwjwf93SPqnJjMJ6z4dKSt-2VTfNxkacWcpvPalgTexpbB8-IZ0i-4IuEDNSJnPalGrNiynFgLVxoc5DmCT6_7Xo2EDPezVW8OreK9kuxyUdnLTapd_iNOhoM4_Pku7rjW4OT60S6EpVNvs Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Project-Id: 2403eb7dab7244b38f69fd11a002c461 Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Project-Name: tempest-VolumesGetTestJSON-790757656 Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2403eb7dab7244b38f69fd11a002c461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2403eb7dab7244b38f69fd11a002c461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2403eb7dab7244b38f69fd11a002c461"}]}] Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Tenant: tempest-VolumesGetTestJSON-790757656 Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Tenant-Id: 2403eb7dab7244b38f69fd11a002c461 Apr 20 15:09:17 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-VolumesGetTestJSON-790757656 Apr 20 15:09:17 user devstack@n-api.service[61508]: X-User: tempest-VolumesGetTestJSON-790757656-project-member Apr 20 15:09:17 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:09:17 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:09:17 user devstack@n-api.service[61508]: X-User-Id: 7c4d35dbebee44739efc5391a470dfeb Apr 20 15:09:17 user devstack@n-api.service[61508]: X-User-Name: tempest-VolumesGetTestJSON-790757656-project-member Apr 20 15:09:17 user devstack@n-api.service[61508]: method: Apr 20 15:09:17 user devstack@n-api.service[61508]: exception: Volume 562035dd-cf71-4fc6-88f5-46e4809dff89 could not be found. Apr 20 15:09:17 user devstack@n-api.service[61508]: action_args: {'id': '562035dd-cf71-4fc6-88f5-46e4809dff89'} Apr 20 15:09:17 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 562035dd-cf71-4fc6-88f5-46e4809dff89 could not be found. (HTTP 404) (Request-ID: req-29502bd1-64ab-4cfb-80a7-9ebe3a5bb62b) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 562035dd-cf71-4fc6-88f5-46e4809dff89 could not be found. Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 562035dd-cf71-4fc6-88f5-46e4809dff89 could not be found. Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 562035dd-cf71-4fc6-88f5-46e4809dff89 could not be found. Apr 20 15:09:17 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:09:17 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-27231662-6b44-4efe-85a9-a0846d1beaac tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] Returning 404 to user: Volume 562035dd-cf71-4fc6-88f5-46e4809dff89 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:09:17 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-27231662-6b44-4efe-85a9-a0846d1beaac tempest-VolumesGetTestJSON-790757656 tempest-VolumesGetTestJSON-790757656-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/562035dd-cf71-4fc6-88f5-46e4809dff89" status: 404 len: 109 microversion: 2.1 time: 0.053636 Apr 20 15:09:17 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 31/93] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 15:09:17 2023] GET /compute/v2.1/os-volumes/562035dd-cf71-4fc6-88f5-46e4809dff89 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:09:24 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:24 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=18 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1475158505", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "networks": [{"uuid": "c89988f1-707d-43c8-8436-3f6107a7fc63"}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] validate_networks() for [('c89988f1-707d-43c8-8436-3f6107a7fc63', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Getting quotas for project 061d2444339049d0a0bb680f55ce75e3. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Getting quotas for user 515a83630b834f03a4fd748fb75b3550 and project 061d2444339049d0a0bb680f55ce75e3. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:09:25 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:09:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-73f7de06-6bc1-4dad-add0-c11cf9b06856 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.027942 Apr 20 15:09:25 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 33/94] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:09:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:09:25 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=7,nova_api:INSERT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:25 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:25 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-6cb480a4-d81a-4e91-8274-bf6ea014bcc0 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:25 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-6cb480a4-d81a-4e91-8274-bf6ea014bcc0 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:09:25 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-6cb480a4-d81a-4e91-8274-bf6ea014bcc0 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515a83630b834f03a4fd748fb75b3550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d2444339049d0a0bb680f55ce75e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:09:26 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-6cb480a4-d81a-4e91-8274-bf6ea014bcc0 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82" status: 200 len: 1211 microversion: 2.1 time: 0.116540 Apr 20 15:09:26 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 31/95] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:09:25 2023] GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=3 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 36c4e175-7373-4a71-85b1-2b6b56ed2d2b] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:26 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-3afce163-f90d-4629-94de-9ceb7977bbd9 tempest-TestShelveInstance-1179118455 tempest-TestShelveInstance-1179118455-project-member] Action: 'create', calling method: .version_select at 0x7fcbb42fab90>, body: {"keypair": {"name": "tempest-TestShelveInstance-1747463374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOeZGmPkoSfNmJrMa/oXf6uVYU5V+7hpw4fCIBqBt6V9YV35iu9OU1fh3Iitrg2sCQqd3EuvVf9wqaKMLceokoZKkAi/EmZ8fkuzaw2VODF3182czDHpeAIbqq7WlDdyg=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:26 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-3afce163-f90d-4629-94de-9ceb7977bbd9 tempest-TestShelveInstance-1179118455 tempest-TestShelveInstance-1179118455-project-member] Getting quotas for project 230ed18099e84de19cc4e58cd10d04d3. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:09:26 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-3afce163-f90d-4629-94de-9ceb7977bbd9 tempest-TestShelveInstance-1179118455 tempest-TestShelveInstance-1179118455-project-member] Getting quotas for user fe4c94f6d5c1420ea72b3df675f134ac and project 230ed18099e84de19cc4e58cd10d04d3. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:09:26 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-3afce163-f90d-4629-94de-9ceb7977bbd9 tempest-TestShelveInstance-1179118455 tempest-TestShelveInstance-1179118455-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.194930 Apr 20 15:09:26 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 34/96] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:09:26 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:09:26 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:09:26 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-fdb5eb09-3364-4773-8aa8-b8dda4c3af93 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b" status: 200 len: 1691 microversion: 2.87 time: 0.544046 Apr 20 15:09:26 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 32/97] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:09:26 2023] GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b => generated 1691 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:09:29 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-8d3a5d7c-e5eb-48e1-9fe5-8ba4c9dc7f7f req-eaf50947-8838-4b94-b0eb-a05465255eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82", "tag": "58eedb9f-ab35-43ae-8c5f-8d95967f0756"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-8d3a5d7c-e5eb-48e1-9fe5-8ba4c9dc7f7f req-eaf50947-8838-4b94-b0eb-a05465255eff service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-8d3a5d7c-e5eb-48e1-9fe5-8ba4c9dc7f7f req-eaf50947-8838-4b94-b0eb-a05465255eff service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-8d3a5d7c-e5eb-48e1-9fe5-8ba4c9dc7f7f req-eaf50947-8838-4b94-b0eb-a05465255eff service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:29 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-8d3a5d7c-e5eb-48e1-9fe5-8ba4c9dc7f7f req-eaf50947-8838-4b94-b0eb-a05465255eff service nova] Creating event network-changed:58eedb9f-ab35-43ae-8c5f-8d95967f0756 for instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 on user Apr 20 15:09:29 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-8d3a5d7c-e5eb-48e1-9fe5-8ba4c9dc7f7f req-eaf50947-8838-4b94-b0eb-a05465255eff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046459 Apr 20 15:09:29 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 32/98] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:09:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:29 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b51b5fee-da1a-4230-b9d9-cda32fd6579b tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:29 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b51b5fee-da1a-4230-b9d9-cda32fd6579b tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] [instance: 40d55224-364c-4989-b6ea-b8ce361d6895] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:09:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b51b5fee-da1a-4230-b9d9-cda32fd6579b tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b51b5fee-da1a-4230-b9d9-cda32fd6579b tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b51b5fee-da1a-4230-b9d9-cda32fd6579b tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b51b5fee-da1a-4230-b9d9-cda32fd6579b tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b51b5fee-da1a-4230-b9d9-cda32fd6579b tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b51b5fee-da1a-4230-b9d9-cda32fd6579b tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:29 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-9c811936-292c-4e5d-a889-7a84962fafc5 tempest-TestShelveInstance-1179118455 tempest-TestShelveInstance-1179118455-project-member] Calling method '.version_select at 0x7fcbb3970a60>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:29 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-9c811936-292c-4e5d-a889-7a84962fafc5 tempest-TestShelveInstance-1179118455 tempest-TestShelveInstance-1179118455-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1747463374" status: 202 len: 0 microversion: 2.1 time: 0.036211 Apr 20 15:09:29 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 20 15:09:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1747463374 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:09:30 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-b51b5fee-da1a-4230-b9d9-cda32fd6579b tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56e16e57c2d43dcafbf0c36a5669107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96c703059b46b2b8c6f08ac7fd6314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:09:30 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b51b5fee-da1a-4230-b9d9-cda32fd6579b tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895" status: 200 len: 1490 microversion: 2.1 time: 0.446627 Apr 20 15:09:30 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 35/100] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:09:29 2023] GET /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895 => generated 1490 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:09:30 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-93140768-6782-41e9-bf92-c50f6c526266 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:30 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-93140768-6782-41e9-bf92-c50f6c526266 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:09:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-93140768-6782-41e9-bf92-c50f6c526266 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-93140768-6782-41e9-bf92-c50f6c526266 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-93140768-6782-41e9-bf92-c50f6c526266 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-93140768-6782-41e9-bf92-c50f6c526266 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-93140768-6782-41e9-bf92-c50f6c526266 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-93140768-6782-41e9-bf92-c50f6c526266 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:30 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-93140768-6782-41e9-bf92-c50f6c526266 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e0c347919c4f92bca310629130038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784602eedf114b789cbe062a0f4d8654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:09:30 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-93140768-6782-41e9-bf92-c50f6c526266 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858" status: 200 len: 1553 microversion: 2.1 time: 0.323084 Apr 20 15:09:30 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 33/101] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:09:30 2023] GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858 => generated 1553 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:09:31 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-63490aeb-db72-4cb1-9a7b-923ac173e7f6 req-f8971424-2795-4867-9178-3d1f5da8abcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82", "name": "network-vif-plugged", "status": "completed", "tag": "58eedb9f-ab35-43ae-8c5f-8d95967f0756"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-63490aeb-db72-4cb1-9a7b-923ac173e7f6 req-f8971424-2795-4867-9178-3d1f5da8abcf service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-63490aeb-db72-4cb1-9a7b-923ac173e7f6 req-f8971424-2795-4867-9178-3d1f5da8abcf service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-63490aeb-db72-4cb1-9a7b-923ac173e7f6 req-f8971424-2795-4867-9178-3d1f5da8abcf service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:31 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-63490aeb-db72-4cb1-9a7b-923ac173e7f6 req-f8971424-2795-4867-9178-3d1f5da8abcf service nova] Creating event network-vif-plugged:58eedb9f-ab35-43ae-8c5f-8d95967f0756 for instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 on user Apr 20 15:09:31 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-63490aeb-db72-4cb1-9a7b-923ac173e7f6 req-f8971424-2795-4867-9178-3d1f5da8abcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054926 Apr 20 15:09:31 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 34/102] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:09:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:33 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-2d6f1792-2597-4a76-99e2-d839b3414f41 req-a58c8af3-a818-44bb-a434-084430d04691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82", "name": "network-vif-plugged", "status": "completed", "tag": "58eedb9f-ab35-43ae-8c5f-8d95967f0756"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:09:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2d6f1792-2597-4a76-99e2-d839b3414f41 req-a58c8af3-a818-44bb-a434-084430d04691 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2d6f1792-2597-4a76-99e2-d839b3414f41 req-a58c8af3-a818-44bb-a434-084430d04691 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2d6f1792-2597-4a76-99e2-d839b3414f41 req-a58c8af3-a818-44bb-a434-084430d04691 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:33 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-2d6f1792-2597-4a76-99e2-d839b3414f41 req-a58c8af3-a818-44bb-a434-084430d04691 service nova] Creating event network-vif-plugged:58eedb9f-ab35-43ae-8c5f-8d95967f0756 for instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 on user Apr 20 15:09:33 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-2d6f1792-2597-4a76-99e2-d839b3414f41 req-a58c8af3-a818-44bb-a434-084430d04691 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039259 Apr 20 15:09:33 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 36/103] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:09:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:09:34 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-8a9d3bbf-6deb-4616-94b2-1e87b95123b0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:34 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-8a9d3bbf-6deb-4616-94b2-1e87b95123b0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:09:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8a9d3bbf-6deb-4616-94b2-1e87b95123b0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8a9d3bbf-6deb-4616-94b2-1e87b95123b0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8a9d3bbf-6deb-4616-94b2-1e87b95123b0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8a9d3bbf-6deb-4616-94b2-1e87b95123b0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8a9d3bbf-6deb-4616-94b2-1e87b95123b0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8a9d3bbf-6deb-4616-94b2-1e87b95123b0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:35 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-8a9d3bbf-6deb-4616-94b2-1e87b95123b0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca4ca64cede4846a74e2cc4c13f3c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb81196155147cea0569f8a96465b6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:09:35 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-8a9d3bbf-6deb-4616-94b2-1e87b95123b0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79" status: 200 len: 1542 microversion: 2.1 time: 0.208598 Apr 20 15:09:35 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 34/104] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:09:34 2023] GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79 => generated 1542 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:09:37 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-6f2fedb8-bf22-4978-b8bd-e0e924563060 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:37 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-6f2fedb8-bf22-4978-b8bd-e0e924563060 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:09:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-6f2fedb8-bf22-4978-b8bd-e0e924563060 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-6f2fedb8-bf22-4978-b8bd-e0e924563060 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-6f2fedb8-bf22-4978-b8bd-e0e924563060 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-6f2fedb8-bf22-4978-b8bd-e0e924563060 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-6f2fedb8-bf22-4978-b8bd-e0e924563060 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-6f2fedb8-bf22-4978-b8bd-e0e924563060 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:37 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-6f2fedb8-bf22-4978-b8bd-e0e924563060 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:09:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-6f2fedb8-bf22-4978-b8bd-e0e924563060 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1540 microversion: 2.1 time: 0.346672 Apr 20 15:09:37 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 35/105] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:09:37 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1540 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=10 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=10 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b91cfa2c-bab8-4c5a-8ae3-3d36478a86dd tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b91cfa2c-bab8-4c5a-8ae3-3d36478a86dd tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: aa981382-1b12-48d6-8661-0ddf1586a9af] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b91cfa2c-bab8-4c5a-8ae3-3d36478a86dd tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b91cfa2c-bab8-4c5a-8ae3-3d36478a86dd tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b91cfa2c-bab8-4c5a-8ae3-3d36478a86dd tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b91cfa2c-bab8-4c5a-8ae3-3d36478a86dd tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b91cfa2c-bab8-4c5a-8ae3-3d36478a86dd tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b91cfa2c-bab8-4c5a-8ae3-3d36478a86dd tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:48 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-b91cfa2c-bab8-4c5a-8ae3-3d36478a86dd tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9585e756e6464da77a49905348b36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaed885af6443a2b5d13ece323b669a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:09:48 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b91cfa2c-bab8-4c5a-8ae3-3d36478a86dd tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af" status: 200 len: 1545 microversion: 2.1 time: 0.331421 Apr 20 15:09:48 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 37/106] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:09:48 2023] GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af => generated 1545 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-9a7973c8-ea80-4db4-8774-2049e59b2c7f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-9a7973c8-ea80-4db4-8774-2049e59b2c7f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] [instance: 22660afa-9082-40e8-9293-82048b1ae755] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=10 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=14 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9a7973c8-ea80-4db4-8774-2049e59b2c7f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9a7973c8-ea80-4db4-8774-2049e59b2c7f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9a7973c8-ea80-4db4-8774-2049e59b2c7f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9a7973c8-ea80-4db4-8774-2049e59b2c7f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9a7973c8-ea80-4db4-8774-2049e59b2c7f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9a7973c8-ea80-4db4-8774-2049e59b2c7f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:09:50 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-9a7973c8-ea80-4db4-8774-2049e59b2c7f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284743e682b48cbb1f0a4090b4c6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37fba0ede194eb6998df9fa7230906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:09:50 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-9a7973c8-ea80-4db4-8774-2049e59b2c7f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755" status: 200 len: 1547 microversion: 2.1 time: 0.214667 Apr 20 15:09:50 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 35/107] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:09:50 2023] GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755 => generated 1547 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-b2d808b8-05da-4454-b619-244914398214 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-b2d808b8-05da-4454-b619-244914398214 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=14 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b2d808b8-05da-4454-b619-244914398214 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b2d808b8-05da-4454-b619-244914398214 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b2d808b8-05da-4454-b619-244914398214 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b2d808b8-05da-4454-b619-244914398214 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b2d808b8-05da-4454-b619-244914398214 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b2d808b8-05da-4454-b619-244914398214 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:16 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-b2d808b8-05da-4454-b619-244914398214 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515a83630b834f03a4fd748fb75b3550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d2444339049d0a0bb680f55ce75e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:10:16 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-b2d808b8-05da-4454-b619-244914398214 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82" status: 200 len: 1494 microversion: 2.1 time: 0.233672 Apr 20 15:10:16 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 36/108] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:10:16 2023] GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 => generated 1494 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:10:26 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:10:26 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:10:26 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-5d534161-03b0-4c78-b82e-b49989635003 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1523722557"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:26 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-5d534161-03b0-4c78-b82e-b49989635003 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 36c4e175-7373-4a71-85b1-2b6b56ed2d2b] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5d534161-03b0-4c78-b82e-b49989635003 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5d534161-03b0-4c78-b82e-b49989635003 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5d534161-03b0-4c78-b82e-b49989635003 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5d534161-03b0-4c78-b82e-b49989635003 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5d534161-03b0-4c78-b82e-b49989635003 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5d534161-03b0-4c78-b82e-b49989635003 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:27 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-5d534161-03b0-4c78-b82e-b49989635003 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "POST /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b/action" status: 202 len: 52 microversion: 2.87 time: 0.857882 Apr 20 15:10:27 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 38/109] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 15:10:26 2023] POST /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b/action => generated 52 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 15:10:30 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-e5b5215c-6dcc-4c3e-bf28-756ba0325f7c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:30 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-e5b5215c-6dcc-4c3e-bf28-756ba0325f7c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:30 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:10:30 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:10:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e5b5215c-6dcc-4c3e-bf28-756ba0325f7c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e5b5215c-6dcc-4c3e-bf28-756ba0325f7c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e5b5215c-6dcc-4c3e-bf28-756ba0325f7c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e5b5215c-6dcc-4c3e-bf28-756ba0325f7c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e5b5215c-6dcc-4c3e-bf28-756ba0325f7c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:30 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e5b5215c-6dcc-4c3e-bf28-756ba0325f7c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:31 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-e5b5215c-6dcc-4c3e-bf28-756ba0325f7c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.204617 Apr 20 15:10:31 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 36/110] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 15:10:30 2023] GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858/os-interface => generated 283 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:31 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-7d3cd1cb-5218-4f78-8229-0449af719462 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:31 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-7d3cd1cb-5218-4f78-8229-0449af719462 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] [instance: 40d55224-364c-4989-b6ea-b8ce361d6895] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:31 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:10:31 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:10:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7d3cd1cb-5218-4f78-8229-0449af719462 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7d3cd1cb-5218-4f78-8229-0449af719462 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7d3cd1cb-5218-4f78-8229-0449af719462 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7d3cd1cb-5218-4f78-8229-0449af719462 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7d3cd1cb-5218-4f78-8229-0449af719462 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7d3cd1cb-5218-4f78-8229-0449af719462 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:32 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-7d3cd1cb-5218-4f78-8229-0449af719462 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] [instance: 40d55224-364c-4989-b6ea-b8ce361d6895] Going to try to terminate instance {{(pid=61508) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:10:32 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-7d3cd1cb-5218-4f78-8229-0449af719462 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895" status: 204 len: 0 microversion: 2.1 time: 0.423670 Apr 20 15:10:32 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 37/111] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:10:31 2023] DELETE /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:10:32 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-770bf15f-0eba-4931-9ceb-5dc25f12a4b5 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:32 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-770bf15f-0eba-4931-9ceb-5dc25f12a4b5 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] [instance: 40d55224-364c-4989-b6ea-b8ce361d6895] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770bf15f-0eba-4931-9ceb-5dc25f12a4b5 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770bf15f-0eba-4931-9ceb-5dc25f12a4b5 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770bf15f-0eba-4931-9ceb-5dc25f12a4b5 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770bf15f-0eba-4931-9ceb-5dc25f12a4b5 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770bf15f-0eba-4931-9ceb-5dc25f12a4b5 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770bf15f-0eba-4931-9ceb-5dc25f12a4b5 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:32 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-82934bd1-c518-46a8-839b-f9127b5ac498 req-b1e3eb24-bfc0-4df0-bc4e-dff13a49a8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43cea1ab-3ddc-401d-97b3-3721808e2858", "tag": "a371311c-f46e-4115-9490-5fb33d90dcd4"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:32 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-770bf15f-0eba-4931-9ceb-5dc25f12a4b5 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56e16e57c2d43dcafbf0c36a5669107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce96c703059b46b2b8c6f08ac7fd6314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:10:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-82934bd1-c518-46a8-839b-f9127b5ac498 req-b1e3eb24-bfc0-4df0-bc4e-dff13a49a8c0 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-82934bd1-c518-46a8-839b-f9127b5ac498 req-b1e3eb24-bfc0-4df0-bc4e-dff13a49a8c0 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-82934bd1-c518-46a8-839b-f9127b5ac498 req-b1e3eb24-bfc0-4df0-bc4e-dff13a49a8c0 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-770bf15f-0eba-4931-9ceb-5dc25f12a4b5 tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895" status: 200 len: 1496 microversion: 2.1 time: 0.279936 Apr 20 15:10:32 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 39/112] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:10:32 2023] GET /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895 => generated 1496 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:10:32 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-82934bd1-c518-46a8-839b-f9127b5ac498 req-b1e3eb24-bfc0-4df0-bc4e-dff13a49a8c0 service nova] Creating event network-changed:a371311c-f46e-4115-9490-5fb33d90dcd4 for instance 43cea1ab-3ddc-401d-97b3-3721808e2858 on user Apr 20 15:10:32 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-82934bd1-c518-46a8-839b-f9127b5ac498 req-b1e3eb24-bfc0-4df0-bc4e-dff13a49a8c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029648 Apr 20 15:10:32 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 37/113] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 15:10:32 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-307ff383-d056-4924-99e2-b0c43bfed00c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-793241012"}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:32 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-307ff383-d056-4924-99e2-b0c43bfed00c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-307ff383-d056-4924-99e2-b0c43bfed00c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-307ff383-d056-4924-99e2-b0c43bfed00c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-307ff383-d056-4924-99e2-b0c43bfed00c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-307ff383-d056-4924-99e2-b0c43bfed00c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-307ff383-d056-4924-99e2-b0c43bfed00c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-307ff383-d056-4924-99e2-b0c43bfed00c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:33 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-307ff383-d056-4924-99e2-b0c43bfed00c tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858/action" status: 202 len: 0 microversion: 2.1 time: 0.848500 Apr 20 15:10:33 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 38/114] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 15:10:32 2023] POST /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 20 15:10:33 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-3772dcac-daa5-415c-9f3a-53a2394c8fc8 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '.version_select at 0x7fcbb3990f70>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:33 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-3772dcac-daa5-415c-9f3a-53a2394c8fc8 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "GET /compute/v2.1/images/4eb2f39f-b427-4a52-9120-58df06c83d1d" status: 200 len: 1608 microversion: 2.1 time: 0.056609 Apr 20 15:10:33 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 40/115] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 15:10:33 2023] GET /compute/v2.1/images/4eb2f39f-b427-4a52-9120-58df06c83d1d => generated 1608 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:10:33 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:33 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 36c4e175-7373-4a71-85b1-2b6b56ed2d2b] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:34 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:10:34 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:10:34 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:10:34 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-55819dd0-9d14-4c90-b194-e9829ece9065 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b" status: 200 len: 1691 microversion: 2.87 time: 0.266966 Apr 20 15:10:34 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 38/116] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:10:33 2023] GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b => generated 1691 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:10:34 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-8accb26b-fcf5-4396-a262-521a509fb310 req-3c8aa08e-5d7a-463b-a099-6a8e179721bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d55224-364c-4989-b6ea-b8ce361d6895", "name": "network-vif-unplugged", "status": "completed", "tag": "b1ca5c7b-c4a5-47b8-b419-c873aea9c510"}, {"server_uuid": "40d55224-364c-4989-b6ea-b8ce361d6895", "name": "network-vif-plugged", "status": "completed", "tag": "b1ca5c7b-c4a5-47b8-b419-c873aea9c510"}, {"server_uuid": "40d55224-364c-4989-b6ea-b8ce361d6895", "name": "network-vif-deleted", "tag": "b1ca5c7b-c4a5-47b8-b419-c873aea9c510"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-8accb26b-fcf5-4396-a262-521a509fb310 req-3c8aa08e-5d7a-463b-a099-6a8e179721bc service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-8accb26b-fcf5-4396-a262-521a509fb310 req-3c8aa08e-5d7a-463b-a099-6a8e179721bc service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-8accb26b-fcf5-4396-a262-521a509fb310 req-3c8aa08e-5d7a-463b-a099-6a8e179721bc service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:34 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-8accb26b-fcf5-4396-a262-521a509fb310 req-3c8aa08e-5d7a-463b-a099-6a8e179721bc service nova] Creating event network-vif-unplugged:b1ca5c7b-c4a5-47b8-b419-c873aea9c510 for instance 40d55224-364c-4989-b6ea-b8ce361d6895 on user Apr 20 15:10:34 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-8accb26b-fcf5-4396-a262-521a509fb310 req-3c8aa08e-5d7a-463b-a099-6a8e179721bc service nova] Creating event network-vif-plugged:b1ca5c7b-c4a5-47b8-b419-c873aea9c510 for instance 40d55224-364c-4989-b6ea-b8ce361d6895 on user Apr 20 15:10:34 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-8accb26b-fcf5-4396-a262-521a509fb310 req-3c8aa08e-5d7a-463b-a099-6a8e179721bc service nova] Creating event network-vif-deleted:b1ca5c7b-c4a5-47b8-b419-c873aea9c510 for instance 40d55224-364c-4989-b6ea-b8ce361d6895 on user Apr 20 15:10:34 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-8accb26b-fcf5-4396-a262-521a509fb310 req-3c8aa08e-5d7a-463b-a099-6a8e179721bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.032965 Apr 20 15:10:34 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 39/117] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:35 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-3b41ee68-fc37-411f-b036-17a3193da4bb tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:35 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-3b41ee68-fc37-411f-b036-17a3193da4bb tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3b41ee68-fc37-411f-b036-17a3193da4bb tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3b41ee68-fc37-411f-b036-17a3193da4bb tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3b41ee68-fc37-411f-b036-17a3193da4bb tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3b41ee68-fc37-411f-b036-17a3193da4bb tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3b41ee68-fc37-411f-b036-17a3193da4bb tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3b41ee68-fc37-411f-b036-17a3193da4bb tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-3b41ee68-fc37-411f-b036-17a3193da4bb tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.156689 Apr 20 15:10:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 41/118] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 15:10:35 2023] GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79/os-interface => generated 282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:36 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-623a7b99-8cdc-4326-9488-75dd43493baf req-2bf475da-88b1-46c1-90dc-8c553e7ed077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f6bf8b-960a-462d-9a05-05f7e4f42f79", "tag": "b01baa05-fe60-4fd6-bff7-359f238cf891"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:36 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-623a7b99-8cdc-4326-9488-75dd43493baf req-2bf475da-88b1-46c1-90dc-8c553e7ed077 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:36 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-623a7b99-8cdc-4326-9488-75dd43493baf req-2bf475da-88b1-46c1-90dc-8c553e7ed077 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:36 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-623a7b99-8cdc-4326-9488-75dd43493baf req-2bf475da-88b1-46c1-90dc-8c553e7ed077 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:36 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-623a7b99-8cdc-4326-9488-75dd43493baf req-2bf475da-88b1-46c1-90dc-8c553e7ed077 service nova] Creating event network-changed:b01baa05-fe60-4fd6-bff7-359f238cf891 for instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 on user Apr 20 15:10:36 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-623a7b99-8cdc-4326-9488-75dd43493baf req-2bf475da-88b1-46c1-90dc-8c553e7ed077 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029605 Apr 20 15:10:36 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:36 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-beffc504-8abf-4d04-af90-a71147ff7fac tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:36 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-beffc504-8abf-4d04-af90-a71147ff7fac tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:36 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-beffc504-8abf-4d04-af90-a71147ff7fac tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:36 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-beffc504-8abf-4d04-af90-a71147ff7fac tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:36 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-beffc504-8abf-4d04-af90-a71147ff7fac tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:36 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-beffc504-8abf-4d04-af90-a71147ff7fac tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:36 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-beffc504-8abf-4d04-af90-a71147ff7fac tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:36 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-beffc504-8abf-4d04-af90-a71147ff7fac tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:36 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-beffc504-8abf-4d04-af90-a71147ff7fac tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79/ips" status: 200 len: 108 microversion: 2.1 time: 0.035242 Apr 20 15:10:36 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 40/120] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 15:10:36 2023] GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79/ips => generated 108 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-4192213c-4805-428a-b23d-8b77705643b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:37 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-4192213c-4805-428a-b23d-8b77705643b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4192213c-4805-428a-b23d-8b77705643b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4192213c-4805-428a-b23d-8b77705643b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4192213c-4805-428a-b23d-8b77705643b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4192213c-4805-428a-b23d-8b77705643b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4192213c-4805-428a-b23d-8b77705643b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4192213c-4805-428a-b23d-8b77705643b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-4192213c-4805-428a-b23d-8b77705643b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.394229 Apr 20 15:10:37 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 42/121] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 15:10:37 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e/os-interface => generated 283 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:37 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-712d52ab-7e60-4541-8d7d-5f0b3a7e533a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:37 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-712d52ab-7e60-4541-8d7d-5f0b3a7e533a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:37 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-712d52ab-7e60-4541-8d7d-5f0b3a7e533a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:37 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-712d52ab-7e60-4541-8d7d-5f0b3a7e533a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:37 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-712d52ab-7e60-4541-8d7d-5f0b3a7e533a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:37 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-712d52ab-7e60-4541-8d7d-5f0b3a7e533a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:37 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-712d52ab-7e60-4541-8d7d-5f0b3a7e533a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:37 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-712d52ab-7e60-4541-8d7d-5f0b3a7e533a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:37 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-712d52ab-7e60-4541-8d7d-5f0b3a7e533a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] Going to try to terminate instance {{(pid=61509) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:10:38 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-712d52ab-7e60-4541-8d7d-5f0b3a7e533a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79" status: 204 len: 0 microversion: 2.1 time: 0.485444 Apr 20 15:10:38 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 40/122] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:10:37 2023] DELETE /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:10:38 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-58ed32be-1d25-4630-b5aa-8175e2a166fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:38 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-58ed32be-1d25-4630-b5aa-8175e2a166fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-58ed32be-1d25-4630-b5aa-8175e2a166fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-58ed32be-1d25-4630-b5aa-8175e2a166fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-58ed32be-1d25-4630-b5aa-8175e2a166fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-58ed32be-1d25-4630-b5aa-8175e2a166fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-58ed32be-1d25-4630-b5aa-8175e2a166fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-58ed32be-1d25-4630-b5aa-8175e2a166fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:38 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-aafa2d5f-266e-44ac-aafa-a8ab7c757919 req-0626f74d-d7be-4713-9fc0-6167259c47a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f6bf8b-960a-462d-9a05-05f7e4f42f79", "name": "network-vif-unplugged", "status": "completed", "tag": "b01baa05-fe60-4fd6-bff7-359f238cf891"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-aafa2d5f-266e-44ac-aafa-a8ab7c757919 req-0626f74d-d7be-4713-9fc0-6167259c47a2 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-aafa2d5f-266e-44ac-aafa-a8ab7c757919 req-0626f74d-d7be-4713-9fc0-6167259c47a2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-aafa2d5f-266e-44ac-aafa-a8ab7c757919 req-0626f74d-d7be-4713-9fc0-6167259c47a2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:38 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-aafa2d5f-266e-44ac-aafa-a8ab7c757919 req-0626f74d-d7be-4713-9fc0-6167259c47a2 service nova] Creating event network-vif-unplugged:b01baa05-fe60-4fd6-bff7-359f238cf891 for instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 on user Apr 20 15:10:38 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-aafa2d5f-266e-44ac-aafa-a8ab7c757919 req-0626f74d-d7be-4713-9fc0-6167259c47a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036118 Apr 20 15:10:38 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 43/123] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:39 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-58ed32be-1d25-4630-b5aa-8175e2a166fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca4ca64cede4846a74e2cc4c13f3c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb81196155147cea0569f8a96465b6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:10:39 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-58ed32be-1d25-4630-b5aa-8175e2a166fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79" status: 200 len: 1667 microversion: 2.1 time: 0.622116 Apr 20 15:10:39 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 41/124] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:10:38 2023] GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79 => generated 1667 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:10:39 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-7ad4bc4b-d2f0-40cc-bb66-de7e4eaa2bbe req-8310a47f-de59-4493-bd16-33b778618f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bb81fa0-7c0d-4144-bce4-fc9053c94e8e", "tag": "893ef125-a4b8-4206-8d2f-d01891c151b8"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:39 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-7ad4bc4b-d2f0-40cc-bb66-de7e4eaa2bbe req-8310a47f-de59-4493-bd16-33b778618f1c service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:39 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-7ad4bc4b-d2f0-40cc-bb66-de7e4eaa2bbe req-8310a47f-de59-4493-bd16-33b778618f1c service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:39 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-7ad4bc4b-d2f0-40cc-bb66-de7e4eaa2bbe req-8310a47f-de59-4493-bd16-33b778618f1c service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:39 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-7ad4bc4b-d2f0-40cc-bb66-de7e4eaa2bbe req-8310a47f-de59-4493-bd16-33b778618f1c service nova] Creating event network-changed:893ef125-a4b8-4206-8d2f-d01891c151b8 for instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e on user Apr 20 15:10:39 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-7ad4bc4b-d2f0-40cc-bb66-de7e4eaa2bbe req-8310a47f-de59-4493-bd16-33b778618f1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028782 Apr 20 15:10:39 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 41/125] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-df3d4361-6ad5-473f-ae07-1cbe076f4a65 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:39 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-df3d4361-6ad5-473f-ae07-1cbe076f4a65 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-df3d4361-6ad5-473f-ae07-1cbe076f4a65 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-df3d4361-6ad5-473f-ae07-1cbe076f4a65 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-df3d4361-6ad5-473f-ae07-1cbe076f4a65 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-df3d4361-6ad5-473f-ae07-1cbe076f4a65 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-df3d4361-6ad5-473f-ae07-1cbe076f4a65 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-df3d4361-6ad5-473f-ae07-1cbe076f4a65 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:39 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-df3d4361-6ad5-473f-ae07-1cbe076f4a65 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:10:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-df3d4361-6ad5-473f-ae07-1cbe076f4a65 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1540 microversion: 2.1 time: 0.167685 Apr 20 15:10:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 44/126] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:10:39 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1540 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:10:39 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-b552c94e-c790-4939-9dac-1da07b97f7b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:39 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-b552c94e-c790-4939-9dac-1da07b97f7b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:39 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b552c94e-c790-4939-9dac-1da07b97f7b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:39 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b552c94e-c790-4939-9dac-1da07b97f7b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:39 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b552c94e-c790-4939-9dac-1da07b97f7b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:39 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b552c94e-c790-4939-9dac-1da07b97f7b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:39 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b552c94e-c790-4939-9dac-1da07b97f7b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:39 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b552c94e-c790-4939-9dac-1da07b97f7b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:39 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-b552c94e-c790-4939-9dac-1da07b97f7b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:10:39 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-b552c94e-c790-4939-9dac-1da07b97f7b6 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1540 microversion: 2.1 time: 0.423709 Apr 20 15:10:39 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:10:39 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1540 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:10:40 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-5ffa24d8-b5f7-4b3e-8add-0f8fc04dabd8 req-429e14d4-485d-439d-9a51-0e398477e43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f6bf8b-960a-462d-9a05-05f7e4f42f79", "name": "network-vif-plugged", "status": "completed", "tag": "b01baa05-fe60-4fd6-bff7-359f238cf891"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-5ffa24d8-b5f7-4b3e-8add-0f8fc04dabd8 req-429e14d4-485d-439d-9a51-0e398477e43e service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-5ffa24d8-b5f7-4b3e-8add-0f8fc04dabd8 req-429e14d4-485d-439d-9a51-0e398477e43e service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-5ffa24d8-b5f7-4b3e-8add-0f8fc04dabd8 req-429e14d4-485d-439d-9a51-0e398477e43e service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:40 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-5ffa24d8-b5f7-4b3e-8add-0f8fc04dabd8 req-429e14d4-485d-439d-9a51-0e398477e43e service nova] Creating event network-vif-plugged:b01baa05-fe60-4fd6-bff7-359f238cf891 for instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 on user Apr 20 15:10:40 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-5ffa24d8-b5f7-4b3e-8add-0f8fc04dabd8 req-429e14d4-485d-439d-9a51-0e398477e43e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028329 Apr 20 15:10:40 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 42/128] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:41 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-45935e7f-776a-4cb0-a93f-b2465ac62989 req-b38cd6cb-2002-465a-a421-12c32bab1a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f6bf8b-960a-462d-9a05-05f7e4f42f79", "name": "network-vif-deleted", "tag": "b01baa05-fe60-4fd6-bff7-359f238cf891"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-45935e7f-776a-4cb0-a93f-b2465ac62989 req-b38cd6cb-2002-465a-a421-12c32bab1a09 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-45935e7f-776a-4cb0-a93f-b2465ac62989 req-b38cd6cb-2002-465a-a421-12c32bab1a09 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-45935e7f-776a-4cb0-a93f-b2465ac62989 req-b38cd6cb-2002-465a-a421-12c32bab1a09 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:41 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-45935e7f-776a-4cb0-a93f-b2465ac62989 req-b38cd6cb-2002-465a-a421-12c32bab1a09 service nova] Creating event network-vif-deleted:b01baa05-fe60-4fd6-bff7-359f238cf891 for instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 on user Apr 20 15:10:41 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-45935e7f-776a-4cb0-a93f-b2465ac62989 req-b38cd6cb-2002-465a-a421-12c32bab1a09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030411 Apr 20 15:10:41 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 45/129] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:48 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-becb4731-308a-4e75-bb52-4f94190d7a71 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:48 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-becb4731-308a-4e75-bb52-4f94190d7a71 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: aa981382-1b12-48d6-8661-0ddf1586a9af] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:48 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-becb4731-308a-4e75-bb52-4f94190d7a71 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:48 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-becb4731-308a-4e75-bb52-4f94190d7a71 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:48 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-becb4731-308a-4e75-bb52-4f94190d7a71 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:48 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-becb4731-308a-4e75-bb52-4f94190d7a71 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:48 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-becb4731-308a-4e75-bb52-4f94190d7a71 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:48 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-becb4731-308a-4e75-bb52-4f94190d7a71 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:49 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-becb4731-308a-4e75-bb52-4f94190d7a71 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.153590 Apr 20 15:10:49 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 43/130] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 15:10:48 2023] GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af/os-interface => generated 282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:49 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-d14f3c1d-a1ac-4640-8a60-e1a9cf957fcc req-753babb9-034e-4098-ac3d-e696bd28e1ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa981382-1b12-48d6-8661-0ddf1586a9af", "tag": "af567b84-ebb0-479c-b788-240ef47450eb"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:49 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-d14f3c1d-a1ac-4640-8a60-e1a9cf957fcc req-753babb9-034e-4098-ac3d-e696bd28e1ee service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:49 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-d14f3c1d-a1ac-4640-8a60-e1a9cf957fcc req-753babb9-034e-4098-ac3d-e696bd28e1ee service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:49 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-d14f3c1d-a1ac-4640-8a60-e1a9cf957fcc req-753babb9-034e-4098-ac3d-e696bd28e1ee service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:49 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-d14f3c1d-a1ac-4640-8a60-e1a9cf957fcc req-753babb9-034e-4098-ac3d-e696bd28e1ee service nova] Creating event network-changed:af567b84-ebb0-479c-b788-240ef47450eb for instance aa981382-1b12-48d6-8661-0ddf1586a9af on user Apr 20 15:10:49 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-d14f3c1d-a1ac-4640-8a60-e1a9cf957fcc req-753babb9-034e-4098-ac3d-e696bd28e1ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030182 Apr 20 15:10:49 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 43/131] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:50 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-baa2c342-a03d-4670-9726-101ddb93bf5f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:50 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-baa2c342-a03d-4670-9726-101ddb93bf5f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] [instance: 22660afa-9082-40e8-9293-82048b1ae755] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-baa2c342-a03d-4670-9726-101ddb93bf5f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-baa2c342-a03d-4670-9726-101ddb93bf5f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-baa2c342-a03d-4670-9726-101ddb93bf5f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-baa2c342-a03d-4670-9726-101ddb93bf5f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-baa2c342-a03d-4670-9726-101ddb93bf5f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-baa2c342-a03d-4670-9726-101ddb93bf5f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:50 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-baa2c342-a03d-4670-9726-101ddb93bf5f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.214721 Apr 20 15:10:50 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 46/132] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 15:10:50 2023] GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755/os-interface => generated 282 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:51 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1546577557", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "networks": [{"uuid": "ae89b425-8bb9-48b2-9ff0-6a977cda42ec"}]}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:51 user devstack@n-api.service[61508]: DEBUG nova.network.neutron [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] validate_networks() for [('ae89b425-8bb9-48b2-9ff0-6a977cda42ec', None, None, None, None, None)] {{(pid=61508) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:10:51 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-ffcbb058-146f-45c5-885f-a9d19fea22ef req-255940e4-a889-45f2-9dff-e3adf36e38d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22660afa-9082-40e8-9293-82048b1ae755", "tag": "7dc2c082-a1a1-4af2-8251-29710d798847"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:51 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-ffcbb058-146f-45c5-885f-a9d19fea22ef req-255940e4-a889-45f2-9dff-e3adf36e38d8 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:51 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-ffcbb058-146f-45c5-885f-a9d19fea22ef req-255940e4-a889-45f2-9dff-e3adf36e38d8 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:51 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-ffcbb058-146f-45c5-885f-a9d19fea22ef req-255940e4-a889-45f2-9dff-e3adf36e38d8 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:51 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-ffcbb058-146f-45c5-885f-a9d19fea22ef req-255940e4-a889-45f2-9dff-e3adf36e38d8 service nova] Creating event network-changed:7dc2c082-a1a1-4af2-8251-29710d798847 for instance 22660afa-9082-40e8-9293-82048b1ae755 on user Apr 20 15:10:51 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-ffcbb058-146f-45c5-885f-a9d19fea22ef req-255940e4-a889-45f2-9dff-e3adf36e38d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031900 Apr 20 15:10:51 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 44/133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Flavor limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Image limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Flavor pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Image pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Getting quotas for project baaed885af6443a2b5d13ece323b669a. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Getting quotas for user bd9585e756e6464da77a49905348b36a and project baaed885af6443a2b5d13ece323b669a. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Going to run 1 instances... {{(pid=61508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:10:52 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: f0ab3cf3-85dc-4f42-b81a-049ced9bac2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:10:52 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-5f99c8d9-1bef-43f7-ab37-7055bbd0a8b0 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.983364 Apr 20 15:10:52 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 44/134] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:10:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:10:52 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-e7cd9cc4-ec39-4153-8e38-ed4a04de21f6 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:52 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-e7cd9cc4-ec39-4153-8e38-ed4a04de21f6 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: f0ab3cf3-85dc-4f42-b81a-049ced9bac2c] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:52 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-e7cd9cc4-ec39-4153-8e38-ed4a04de21f6 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9585e756e6464da77a49905348b36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaed885af6443a2b5d13ece323b669a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:10:52 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-e7cd9cc4-ec39-4153-8e38-ed4a04de21f6 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c" status: 200 len: 1212 microversion: 2.1 time: 0.072359 Apr 20 15:10:52 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 47/135] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:10:52 2023] GET /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c => generated 1212 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:10:53 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-a8dd578f-efd0-4221-8ef4-c344178be8b9 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:53 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-a8dd578f-efd0-4221-8ef4-c344178be8b9 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] [instance: 22660afa-9082-40e8-9293-82048b1ae755] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:53 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a8dd578f-efd0-4221-8ef4-c344178be8b9 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:53 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a8dd578f-efd0-4221-8ef4-c344178be8b9 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:53 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a8dd578f-efd0-4221-8ef4-c344178be8b9 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:53 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a8dd578f-efd0-4221-8ef4-c344178be8b9 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:53 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a8dd578f-efd0-4221-8ef4-c344178be8b9 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:53 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a8dd578f-efd0-4221-8ef4-c344178be8b9 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:53 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-a8dd578f-efd0-4221-8ef4-c344178be8b9 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] [instance: 22660afa-9082-40e8-9293-82048b1ae755] Going to try to terminate instance {{(pid=61509) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:10:53 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-a8dd578f-efd0-4221-8ef4-c344178be8b9 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755" status: 204 len: 0 microversion: 2.1 time: 0.111517 Apr 20 15:10:53 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:10:53 2023] DELETE /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:10:53 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-48f6c31c-887a-4fe9-8f3c-445de3a65ae8 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:10:53 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-48f6c31c-887a-4fe9-8f3c-445de3a65ae8 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] [instance: 22660afa-9082-40e8-9293-82048b1ae755] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:10:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-48f6c31c-887a-4fe9-8f3c-445de3a65ae8 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-48f6c31c-887a-4fe9-8f3c-445de3a65ae8 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-48f6c31c-887a-4fe9-8f3c-445de3a65ae8 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-48f6c31c-887a-4fe9-8f3c-445de3a65ae8 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-48f6c31c-887a-4fe9-8f3c-445de3a65ae8 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-48f6c31c-887a-4fe9-8f3c-445de3a65ae8 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:53 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-759880eb-e851-426d-8925-4bda324b02bb req-f27de037-8029-496b-809a-05933950ccb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22660afa-9082-40e8-9293-82048b1ae755", "name": "network-vif-unplugged", "status": "completed", "tag": "7dc2c082-a1a1-4af2-8251-29710d798847"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:53 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-759880eb-e851-426d-8925-4bda324b02bb req-f27de037-8029-496b-809a-05933950ccb3 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:53 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-759880eb-e851-426d-8925-4bda324b02bb req-f27de037-8029-496b-809a-05933950ccb3 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:53 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-759880eb-e851-426d-8925-4bda324b02bb req-f27de037-8029-496b-809a-05933950ccb3 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:53 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-759880eb-e851-426d-8925-4bda324b02bb req-f27de037-8029-496b-809a-05933950ccb3 service nova] Creating event network-vif-unplugged:7dc2c082-a1a1-4af2-8251-29710d798847 for instance 22660afa-9082-40e8-9293-82048b1ae755 on user Apr 20 15:10:53 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-759880eb-e851-426d-8925-4bda324b02bb req-f27de037-8029-496b-809a-05933950ccb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031485 Apr 20 15:10:53 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 48/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:53 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-48f6c31c-887a-4fe9-8f3c-445de3a65ae8 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284743e682b48cbb1f0a4090b4c6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37fba0ede194eb6998df9fa7230906c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:10:53 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-48f6c31c-887a-4fe9-8f3c-445de3a65ae8 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755" status: 200 len: 1671 microversion: 2.1 time: 0.384024 Apr 20 15:10:53 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 45/138] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:10:53 2023] GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755 => generated 1671 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:10:54 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-991c8412-13b2-4fc5-9e66-44b747ec9897 req-43814f1e-b6e7-4bd8-9322-22f9f01d635d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22660afa-9082-40e8-9293-82048b1ae755", "name": "network-vif-deleted", "tag": "7dc2c082-a1a1-4af2-8251-29710d798847"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-991c8412-13b2-4fc5-9e66-44b747ec9897 req-43814f1e-b6e7-4bd8-9322-22f9f01d635d service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-991c8412-13b2-4fc5-9e66-44b747ec9897 req-43814f1e-b6e7-4bd8-9322-22f9f01d635d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-991c8412-13b2-4fc5-9e66-44b747ec9897 req-43814f1e-b6e7-4bd8-9322-22f9f01d635d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:54 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-991c8412-13b2-4fc5-9e66-44b747ec9897 req-43814f1e-b6e7-4bd8-9322-22f9f01d635d service nova] Creating event network-vif-deleted:7dc2c082-a1a1-4af2-8251-29710d798847 for instance 22660afa-9082-40e8-9293-82048b1ae755 on user Apr 20 15:10:54 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-991c8412-13b2-4fc5-9e66-44b747ec9897 req-43814f1e-b6e7-4bd8-9322-22f9f01d635d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033123 Apr 20 15:10:54 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:55 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-71f0ee55-2622-42c3-ae5c-cd1c75a747a9 req-17f8c12c-61e1-4a61-b8e3-aa721a08e9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22660afa-9082-40e8-9293-82048b1ae755", "name": "network-vif-plugged", "status": "completed", "tag": "7dc2c082-a1a1-4af2-8251-29710d798847"}, {"name": "network-changed", "server_uuid": "f0ab3cf3-85dc-4f42-b81a-049ced9bac2c", "tag": "1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-71f0ee55-2622-42c3-ae5c-cd1c75a747a9 req-17f8c12c-61e1-4a61-b8e3-aa721a08e9ec service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-71f0ee55-2622-42c3-ae5c-cd1c75a747a9 req-17f8c12c-61e1-4a61-b8e3-aa721a08e9ec service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-71f0ee55-2622-42c3-ae5c-cd1c75a747a9 req-17f8c12c-61e1-4a61-b8e3-aa721a08e9ec service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:55 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-71f0ee55-2622-42c3-ae5c-cd1c75a747a9 req-17f8c12c-61e1-4a61-b8e3-aa721a08e9ec service nova] Creating event network-vif-plugged:7dc2c082-a1a1-4af2-8251-29710d798847 for instance 22660afa-9082-40e8-9293-82048b1ae755 on user Apr 20 15:10:55 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-71f0ee55-2622-42c3-ae5c-cd1c75a747a9 req-17f8c12c-61e1-4a61-b8e3-aa721a08e9ec service nova] Creating event network-changed:1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867 for instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c on user Apr 20 15:10:55 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-71f0ee55-2622-42c3-ae5c-cd1c75a747a9 req-17f8c12c-61e1-4a61-b8e3-aa721a08e9ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.033235 Apr 20 15:10:55 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 49/140] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:55 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:57 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-462a83a0-750e-49b8-9443-7c1b7386db31 req-1ee0ed35-bb3d-42e9-b0cc-3dfbb585f139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ab3cf3-85dc-4f42-b81a-049ced9bac2c", "name": "network-vif-plugged", "status": "completed", "tag": "1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:57 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-462a83a0-750e-49b8-9443-7c1b7386db31 req-1ee0ed35-bb3d-42e9-b0cc-3dfbb585f139 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:57 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-462a83a0-750e-49b8-9443-7c1b7386db31 req-1ee0ed35-bb3d-42e9-b0cc-3dfbb585f139 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:57 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-462a83a0-750e-49b8-9443-7c1b7386db31 req-1ee0ed35-bb3d-42e9-b0cc-3dfbb585f139 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:57 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-462a83a0-750e-49b8-9443-7c1b7386db31 req-1ee0ed35-bb3d-42e9-b0cc-3dfbb585f139 service nova] Creating event network-vif-plugged:1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867 for instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c on user Apr 20 15:10:57 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-462a83a0-750e-49b8-9443-7c1b7386db31 req-1ee0ed35-bb3d-42e9-b0cc-3dfbb585f139 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027846 Apr 20 15:10:57 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 46/141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:10:59 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-eca0e88f-de4b-4348-8fcf-398190c76642 req-773dc09f-763d-4121-b1dd-80239c6876b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ab3cf3-85dc-4f42-b81a-049ced9bac2c", "name": "network-vif-plugged", "status": "completed", "tag": "1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:10:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-eca0e88f-de4b-4348-8fcf-398190c76642 req-773dc09f-763d-4121-b1dd-80239c6876b8 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:10:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-eca0e88f-de4b-4348-8fcf-398190c76642 req-773dc09f-763d-4121-b1dd-80239c6876b8 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:10:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-eca0e88f-de4b-4348-8fcf-398190c76642 req-773dc09f-763d-4121-b1dd-80239c6876b8 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:10:59 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-eca0e88f-de4b-4348-8fcf-398190c76642 req-773dc09f-763d-4121-b1dd-80239c6876b8 service nova] Creating event network-vif-plugged:1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867 for instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c on user Apr 20 15:10:59 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-eca0e88f-de4b-4348-8fcf-398190c76642 req-773dc09f-763d-4121-b1dd-80239c6876b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029403 Apr 20 15:10:59 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 47/142] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:10:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:11:16 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:16 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=24 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:16 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:16 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-815588613", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "networks": [{"uuid": "c89988f1-707d-43c8-8436-3f6107a7fc63"}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:16 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] validate_networks() for [('c89988f1-707d-43c8-8436-3f6107a7fc63', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Getting quotas for project 061d2444339049d0a0bb680f55ce75e3. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Getting quotas for user 515a83630b834f03a4fd748fb75b3550 and project 061d2444339049d0a0bb680f55ce75e3. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:11:17 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: c62c36e6-6410-4f7d-9968-e0e7bded79fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:11:17 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-4cda4b14-927e-4b56-a27b-fc5869877053 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.939391 Apr 20 15:11:17 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 50/143] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:11:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:11:17 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-1ab6d79f-f5f1-4b46-81e0-8c29e236bdc0 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:17 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-1ab6d79f-f5f1-4b46-81e0-8c29e236bdc0 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: c62c36e6-6410-4f7d-9968-e0e7bded79fc] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:17 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:17 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:17 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:17 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:17 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-1ab6d79f-f5f1-4b46-81e0-8c29e236bdc0 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515a83630b834f03a4fd748fb75b3550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d2444339049d0a0bb680f55ce75e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:11:17 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-1ab6d79f-f5f1-4b46-81e0-8c29e236bdc0 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc" status: 200 len: 1210 microversion: 2.1 time: 0.075845 Apr 20 15:11:17 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 47/144] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:17 2023] GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc => generated 1210 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:11:20 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:20 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:20 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-6b3b23a1-172e-4a20-928b-a4e456be2cc0 req-ca285193-e8f8-43ac-a51d-de2e955eb3cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c62c36e6-6410-4f7d-9968-e0e7bded79fc", "tag": "e8ff5f7f-a025-473b-9ba7-9f46f52eb040"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:20 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-6b3b23a1-172e-4a20-928b-a4e456be2cc0 req-ca285193-e8f8-43ac-a51d-de2e955eb3cb service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:20 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-6b3b23a1-172e-4a20-928b-a4e456be2cc0 req-ca285193-e8f8-43ac-a51d-de2e955eb3cb service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:20 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-6b3b23a1-172e-4a20-928b-a4e456be2cc0 req-ca285193-e8f8-43ac-a51d-de2e955eb3cb service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:20 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-6b3b23a1-172e-4a20-928b-a4e456be2cc0 req-ca285193-e8f8-43ac-a51d-de2e955eb3cb service nova] Creating event network-changed:e8ff5f7f-a025-473b-9ba7-9f46f52eb040 for instance c62c36e6-6410-4f7d-9968-e0e7bded79fc on user Apr 20 15:11:20 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-6b3b23a1-172e-4a20-928b-a4e456be2cc0 req-ca285193-e8f8-43ac-a51d-de2e955eb3cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040278 Apr 20 15:11:20 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 48/145] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:11:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:11:22 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-43bafdf3-43af-4b75-b489-714b9ddc76e2 req-cdbe7495-8eb2-4f47-bd9a-ab9d9bb3303e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62c36e6-6410-4f7d-9968-e0e7bded79fc", "name": "network-vif-plugged", "status": "completed", "tag": "e8ff5f7f-a025-473b-9ba7-9f46f52eb040"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-43bafdf3-43af-4b75-b489-714b9ddc76e2 req-cdbe7495-8eb2-4f47-bd9a-ab9d9bb3303e service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-43bafdf3-43af-4b75-b489-714b9ddc76e2 req-cdbe7495-8eb2-4f47-bd9a-ab9d9bb3303e service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-43bafdf3-43af-4b75-b489-714b9ddc76e2 req-cdbe7495-8eb2-4f47-bd9a-ab9d9bb3303e service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:22 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-43bafdf3-43af-4b75-b489-714b9ddc76e2 req-cdbe7495-8eb2-4f47-bd9a-ab9d9bb3303e service nova] Creating event network-vif-plugged:e8ff5f7f-a025-473b-9ba7-9f46f52eb040 for instance c62c36e6-6410-4f7d-9968-e0e7bded79fc on user Apr 20 15:11:22 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-43bafdf3-43af-4b75-b489-714b9ddc76e2 req-cdbe7495-8eb2-4f47-bd9a-ab9d9bb3303e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053812 Apr 20 15:11:22 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 51/146] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:11:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:11:22 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:22 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] [instance: 40d55224-364c-4989-b6ea-b8ce361d6895] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:22 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:22 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:22 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:22 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:22 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:22 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:22 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] HTTP exception thrown: Instance 40d55224-364c-4989-b6ea-b8ce361d6895 could not be found. Apr 20 15:11:22 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Request method failure captured: Apr 20 15:11:22 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895 HTTP/1.1 Apr 20 15:11:22 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:11:22 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:11:22 user devstack@n-api.service[61508]: Connection: close Apr 20 15:11:22 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:11:22 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:11:22 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:11:22 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:11:22 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVV1P0BNDsHUgeGBZbr8rwV7pZI2zHxKlQtudXwwt83aAn_gcoqnU80hz49EbY79TPfSf8Nako72O6qlhSyY8R_ZphjWkajahG-JIYnX8Rvoj1xvbtud45TYY0iLegOOvCgGL8s8s0moTE_3bI5wT8JQjNU_kN3dtXBz3po5t88LMV8 Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Project-Id: ce96c703059b46b2b8c6f08ac7fd6314 Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Project-Name: tempest-DeleteServersTestJSON-419018244 Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce96c703059b46b2b8c6f08ac7fd6314"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce96c703059b46b2b8c6f08ac7fd6314"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce96c703059b46b2b8c6f08ac7fd6314"}]}] Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Tenant: tempest-DeleteServersTestJSON-419018244 Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Tenant-Id: ce96c703059b46b2b8c6f08ac7fd6314 Apr 20 15:11:22 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-DeleteServersTestJSON-419018244 Apr 20 15:11:22 user devstack@n-api.service[61508]: X-User: tempest-DeleteServersTestJSON-419018244-project-member Apr 20 15:11:22 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:11:22 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:11:22 user devstack@n-api.service[61508]: X-User-Id: e56e16e57c2d43dcafbf0c36a5669107 Apr 20 15:11:22 user devstack@n-api.service[61508]: X-User-Name: tempest-DeleteServersTestJSON-419018244-project-member Apr 20 15:11:22 user devstack@n-api.service[61508]: method: > Apr 20 15:11:22 user devstack@n-api.service[61508]: exception: Instance 40d55224-364c-4989-b6ea-b8ce361d6895 could not be found. Apr 20 15:11:22 user devstack@n-api.service[61508]: action_args: {'id': '40d55224-364c-4989-b6ea-b8ce361d6895'} Apr 20 15:11:22 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d55224-364c-4989-b6ea-b8ce361d6895 could not be found. Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d55224-364c-4989-b6ea-b8ce361d6895 could not be found. Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d55224-364c-4989-b6ea-b8ce361d6895 could not be found. Apr 20 15:11:22 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:22 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] Returning 404 to user: Instance 40d55224-364c-4989-b6ea-b8ce361d6895 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:11:22 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-cd17a2c6-e9fa-4a5e-a150-93033e6caa7f tempest-DeleteServersTestJSON-419018244 tempest-DeleteServersTestJSON-419018244-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895" status: 404 len: 111 microversion: 2.1 time: 0.034463 Apr 20 15:11:22 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 48/147] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:22 2023] GET /compute/v2.1/servers/40d55224-364c-4989-b6ea-b8ce361d6895 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:11:23 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-879a6e6f-4982-4248-9f7f-9b5d47e06dab tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '.version_select at 0x7fcbb42cd480>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:23 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-879a6e6f-4982-4248-9f7f-9b5d47e06dab tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "GET /compute/v2.1/images/4eb2f39f-b427-4a52-9120-58df06c83d1d" status: 200 len: 1722 microversion: 2.1 time: 0.052205 Apr 20 15:11:23 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 49/148] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 15:11:23 2023] GET /compute/v2.1/images/4eb2f39f-b427-4a52-9120-58df06c83d1d => generated 1722 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:11:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-0ffe7290-69df-48fa-9e7c-d7e0674054b6 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '.version_select at 0x7fcbb39930a0>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:23 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-0ffe7290-69df-48fa-9e7c-d7e0674054b6 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "GET /compute/v2.1/images/4eb2f39f-b427-4a52-9120-58df06c83d1d" status: 200 len: 1722 microversion: 2.1 time: 0.064820 Apr 20 15:11:23 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 52/149] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 15:11:23 2023] GET /compute/v2.1/images/4eb2f39f-b427-4a52-9120-58df06c83d1d => generated 1722 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:11:23 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-bddfbf2c-1aaf-4c47-923d-7fd7143ac9b2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:23 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-bddfbf2c-1aaf-4c47-923d-7fd7143ac9b2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-bddfbf2c-1aaf-4c47-923d-7fd7143ac9b2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-bddfbf2c-1aaf-4c47-923d-7fd7143ac9b2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-bddfbf2c-1aaf-4c47-923d-7fd7143ac9b2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-bddfbf2c-1aaf-4c47-923d-7fd7143ac9b2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-bddfbf2c-1aaf-4c47-923d-7fd7143ac9b2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-bddfbf2c-1aaf-4c47-923d-7fd7143ac9b2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:23 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-bddfbf2c-1aaf-4c47-923d-7fd7143ac9b2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e0c347919c4f92bca310629130038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784602eedf114b789cbe062a0f4d8654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:11:23 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-bddfbf2c-1aaf-4c47-923d-7fd7143ac9b2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858" status: 200 len: 1672 microversion: 2.1 time: 0.234338 Apr 20 15:11:23 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 49/150] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:23 2023] GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858 => generated 1672 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:11:24 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-d1a0d4b3-b6c1-46fd-8be3-d1700d4d58c3 req-5072a9e2-9063-4108-909e-a68ee394caba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62c36e6-6410-4f7d-9968-e0e7bded79fc", "name": "network-vif-plugged", "status": "completed", "tag": "e8ff5f7f-a025-473b-9ba7-9f46f52eb040"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-d1a0d4b3-b6c1-46fd-8be3-d1700d4d58c3 req-5072a9e2-9063-4108-909e-a68ee394caba service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-d1a0d4b3-b6c1-46fd-8be3-d1700d4d58c3 req-5072a9e2-9063-4108-909e-a68ee394caba service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-d1a0d4b3-b6c1-46fd-8be3-d1700d4d58c3 req-5072a9e2-9063-4108-909e-a68ee394caba service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:24 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-d1a0d4b3-b6c1-46fd-8be3-d1700d4d58c3 req-5072a9e2-9063-4108-909e-a68ee394caba service nova] Creating event network-vif-plugged:e8ff5f7f-a025-473b-9ba7-9f46f52eb040 for instance c62c36e6-6410-4f7d-9968-e0e7bded79fc on user Apr 20 15:11:24 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-d1a0d4b3-b6c1-46fd-8be3-d1700d4d58c3 req-5072a9e2-9063-4108-909e-a68ee394caba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054106 Apr 20 15:11:24 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:11:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:29 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] HTTP exception thrown: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Request method failure captured: Apr 20 15:11:29 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79 HTTP/1.1 Apr 20 15:11:29 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:11:29 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:11:29 user devstack@n-api.service[61510]: Connection: close Apr 20 15:11:29 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:11:29 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:11:29 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:11:29 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:11:29 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVVx-U3QuV56Gy0TyipJvTPOcFQQTpehiuNsftdc0T5QMNXwtHTigVlX6LYAeTyjlobrUG05VFTlPrv0JZi9TUXTchee5Zjkc8RQE1BVwMrQG1dhl_fNaPnphr8mz74teZGGMRCnAaE9JAkOBDCXRc0vrPyW0Iq_TLcRQUBNHMdGhkE Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Project-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bb81196155147cea0569f8a96465b6a"}]}] Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Tenant-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:11:29 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:11:29 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:11:29 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:11:29 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:11:29 user devstack@n-api.service[61510]: X-User-Id: 8ca4ca64cede4846a74e2cc4c13f3c14 Apr 20 15:11:29 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:11:29 user devstack@n-api.service[61510]: method: > Apr 20 15:11:29 user devstack@n-api.service[61510]: exception: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:11:29 user devstack@n-api.service[61510]: action_args: {'id': '88f6bf8b-960a-462d-9a05-05f7e4f42f79'} Apr 20 15:11:29 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:11:29 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:11:29 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Returning 404 to user: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:11:29 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f004872f-0ac1-4713-b217-3c9c95c2a1ef tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79" status: 404 len: 111 microversion: 2.1 time: 0.046248 Apr 20 15:11:29 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 53/152] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:29 2023] GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:11:29 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-2e47f0d8-58e2-45b0-af3a-5f51f2f0b66e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '.version_select at 0x7fcbb37a5c60>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:29 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:29 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-2e47f0d8-58e2-45b0-af3a-5f51f2f0b66e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-847970234" status: 202 len: 0 microversion: 2.1 time: 0.027874 Apr 20 15:11:29 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 50/153] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 15:11:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-847970234 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:11:29 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-562beaa4-7e5e-4cd8-a26e-18ca8075b302 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:29 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-562beaa4-7e5e-4cd8-a26e-18ca8075b302 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-562beaa4-7e5e-4cd8-a26e-18ca8075b302 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-562beaa4-7e5e-4cd8-a26e-18ca8075b302 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-562beaa4-7e5e-4cd8-a26e-18ca8075b302 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-562beaa4-7e5e-4cd8-a26e-18ca8075b302 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-562beaa4-7e5e-4cd8-a26e-18ca8075b302 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-562beaa4-7e5e-4cd8-a26e-18ca8075b302 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:30 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-562beaa4-7e5e-4cd8-a26e-18ca8075b302 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:11:30 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-562beaa4-7e5e-4cd8-a26e-18ca8075b302 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.264841 Apr 20 15:11:30 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:29 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:11:30 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-0269a0d7-15c5-4196-b808-8077db2c65ac tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:30 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-0269a0d7-15c5-4196-b808-8077db2c65ac tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0269a0d7-15c5-4196-b808-8077db2c65ac tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0269a0d7-15c5-4196-b808-8077db2c65ac tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0269a0d7-15c5-4196-b808-8077db2c65ac tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0269a0d7-15c5-4196-b808-8077db2c65ac tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0269a0d7-15c5-4196-b808-8077db2c65ac tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0269a0d7-15c5-4196-b808-8077db2c65ac tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:30 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-168bb481-7d65-4d6c-a3c1-690f7f326fa4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Action: 'create', calling method: .version_select at 0x7fcbb37a5ea0>, body: {"keypair": {"name": "tempest-keypair-1083332030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsPytqnYrNfCB5EoevItmQULXsv7KoDhjQhRxe0nW548xoaR1XlPyU4eJY0kjW2Ew3YOTwLjkRMOytJPAPD0OedNL0coIQnLbE0ahkHnRXNsNH1VZtksF5ZiogGBUGVqA=="}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:30 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-168bb481-7d65-4d6c-a3c1-690f7f326fa4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for project 5bb81196155147cea0569f8a96465b6a. Resources: {'key_pairs'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:11:30 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-168bb481-7d65-4d6c-a3c1-690f7f326fa4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for user 8ca4ca64cede4846a74e2cc4c13f3c14 and project 5bb81196155147cea0569f8a96465b6a. Resources: {'key_pairs'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:11:30 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-168bb481-7d65-4d6c-a3c1-690f7f326fa4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052207 Apr 20 15:11:30 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 51/155] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:11:30 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:11:30 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-0269a0d7-15c5-4196-b808-8077db2c65ac tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:11:30 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-0269a0d7-15c5-4196-b808-8077db2c65ac tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.415761 Apr 20 15:11:30 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 54/156] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:30 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-211625695", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "edb31b42-2f23-479e-8912-fbfd502dae97"}], "security_groups": [{"name": "tempest-securitygroup--1287487394"}], "key_name": "tempest-keypair-1083332030", "user_data": "}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.network.neutron [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] validate_networks() for [('edb31b42-2f23-479e-8912-fbfd502dae97', None, None, None, None, None)] {{(pid=61509) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Flavor limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Image limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Flavor pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Image pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for project 5bb81196155147cea0569f8a96465b6a. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for user 8ca4ca64cede4846a74e2cc4c13f3c14 and project 5bb81196155147cea0569f8a96465b6a. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Going to run 1 instances... {{(pid=61509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:11:32 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:11:32 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-7bcc66ac-7549-4edd-86a8-ff5494f1eb7b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.696479 Apr 20 15:11:32 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 52/157] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:11:32 2023] POST /compute/v2.1/servers => generated 400 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:11:32 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-f8a3a5ba-813e-4e39-9e35-40cdd640fb28 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:32 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-f8a3a5ba-813e-4e39-9e35-40cdd640fb28 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:32 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-f8a3a5ba-813e-4e39-9e35-40cdd640fb28 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca4ca64cede4846a74e2cc4c13f3c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb81196155147cea0569f8a96465b6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:11:33 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-f8a3a5ba-813e-4e39-9e35-40cdd640fb28 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f" status: 200 len: 1235 microversion: 2.1 time: 0.091770 Apr 20 15:11:33 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:32 2023] GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f => generated 1235 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:11:34 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-476504555", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "3626f883-4d6a-49ba-95ea-b76718169d69"}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:34 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] validate_networks() for [('3626f883-4d6a-49ba-95ea-b76718169d69', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Getting quotas for project b53c73dfc9094d05802c05b2f25d6bed. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Getting quotas for user f19d8fcc1b69479992ff0d8bc5c99306 and project b53c73dfc9094d05802c05b2f25d6bed. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:11:35 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:11:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f5113a77-9811-4b11-90ea-f2038dac7c10 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.123245 Apr 20 15:11:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 55/159] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 15:11:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 15:11:35 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-647a04b2-94dc-4ba8-95ad-561a8bfc077c tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:35 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-647a04b2-94dc-4ba8-95ad-561a8bfc077c tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:35 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-647a04b2-94dc-4ba8-95ad-561a8bfc077c tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:11:35 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-647a04b2-94dc-4ba8-95ad-561a8bfc077c tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:11:35 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-647a04b2-94dc-4ba8-95ad-561a8bfc077c tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:11:35 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-647a04b2-94dc-4ba8-95ad-561a8bfc077c tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd" status: 200 len: 1394 microversion: 2.87 time: 0.089398 Apr 20 15:11:35 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 53/160] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:11:35 2023] GET /compute/v2.1/servers/f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd => generated 1394 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:11:36 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-3a0bbd41-1ce5-4db3-b848-c671cc52ee0c req-5fd534a9-2f17-4635-a2d9-1d99786088c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77755cf9-9e1b-4a77-a1e2-628876c5e06f", "tag": "30e678fc-1a8f-4b06-abee-54c719d1e99a"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:36 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=8 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:36 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-3a0bbd41-1ce5-4db3-b848-c671cc52ee0c req-5fd534a9-2f17-4635-a2d9-1d99786088c4 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:36 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-3a0bbd41-1ce5-4db3-b848-c671cc52ee0c req-5fd534a9-2f17-4635-a2d9-1d99786088c4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:36 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-3a0bbd41-1ce5-4db3-b848-c671cc52ee0c req-5fd534a9-2f17-4635-a2d9-1d99786088c4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:36 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-3a0bbd41-1ce5-4db3-b848-c671cc52ee0c req-5fd534a9-2f17-4635-a2d9-1d99786088c4 service nova] Creating event network-changed:30e678fc-1a8f-4b06-abee-54c719d1e99a for instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f on user Apr 20 15:11:36 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-3a0bbd41-1ce5-4db3-b848-c671cc52ee0c req-5fd534a9-2f17-4635-a2d9-1d99786088c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036886 Apr 20 15:11:36 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 53/161] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:11:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:11:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-27479f94-c4c8-455e-a5eb-bc22a3e7e8e7 req-d911551b-4ccb-4760-a0e1-eb92789b05ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd", "tag": "42ee4867-2d03-488d-85f1-cf192f57845c"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-27479f94-c4c8-455e-a5eb-bc22a3e7e8e7 req-d911551b-4ccb-4760-a0e1-eb92789b05ff service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-27479f94-c4c8-455e-a5eb-bc22a3e7e8e7 req-d911551b-4ccb-4760-a0e1-eb92789b05ff service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-27479f94-c4c8-455e-a5eb-bc22a3e7e8e7 req-d911551b-4ccb-4760-a0e1-eb92789b05ff service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-27479f94-c4c8-455e-a5eb-bc22a3e7e8e7 req-d911551b-4ccb-4760-a0e1-eb92789b05ff service nova] Creating event network-changed:42ee4867-2d03-488d-85f1-cf192f57845c for instance f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd on user Apr 20 15:11:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-27479f94-c4c8-455e-a5eb-bc22a3e7e8e7 req-d911551b-4ccb-4760-a0e1-eb92789b05ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030415 Apr 20 15:11:37 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 56/162] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:11:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:11:38 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-91c9d967-f32f-404a-a660-9728cda03367 req-388de79d-099b-4a18-a822-ff413f992756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77755cf9-9e1b-4a77-a1e2-628876c5e06f", "name": "network-vif-plugged", "status": "completed", "tag": "30e678fc-1a8f-4b06-abee-54c719d1e99a"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-91c9d967-f32f-404a-a660-9728cda03367 req-388de79d-099b-4a18-a822-ff413f992756 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-91c9d967-f32f-404a-a660-9728cda03367 req-388de79d-099b-4a18-a822-ff413f992756 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-91c9d967-f32f-404a-a660-9728cda03367 req-388de79d-099b-4a18-a822-ff413f992756 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:38 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-91c9d967-f32f-404a-a660-9728cda03367 req-388de79d-099b-4a18-a822-ff413f992756 service nova] Creating event network-vif-plugged:30e678fc-1a8f-4b06-abee-54c719d1e99a for instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f on user Apr 20 15:11:38 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-91c9d967-f32f-404a-a660-9728cda03367 req-388de79d-099b-4a18-a822-ff413f992756 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031258 Apr 20 15:11:38 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 54/163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:11:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:11:39 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-0ffba75d-5fc6-4025-bcc0-33c2112f934f req-283b35c2-e439-43a3-8208-27d05b99791b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd", "name": "network-vif-deleted", "tag": "42ee4867-2d03-488d-85f1-cf192f57845c"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-0ffba75d-5fc6-4025-bcc0-33c2112f934f req-283b35c2-e439-43a3-8208-27d05b99791b service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-0ffba75d-5fc6-4025-bcc0-33c2112f934f req-283b35c2-e439-43a3-8208-27d05b99791b service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-0ffba75d-5fc6-4025-bcc0-33c2112f934f req-283b35c2-e439-43a3-8208-27d05b99791b service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:40 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.compute.server_external_events [req-0ffba75d-5fc6-4025-bcc0-33c2112f934f req-283b35c2-e439-43a3-8208-27d05b99791b service nova] Unable to find a host for instance f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd. Dropping event network-vif-deleted {{(pid=61508) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 15:11:40 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-0ffba75d-5fc6-4025-bcc0-33c2112f934f req-283b35c2-e439-43a3-8208-27d05b99791b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.039565 Apr 20 15:11:40 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 54/164] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:11:39 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 15:11:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-b2eeed88-0eff-47a7-9201-bb5af2048185 req-44da7d04-5d36-4fd2-8237-eb29e3bf6c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77755cf9-9e1b-4a77-a1e2-628876c5e06f", "name": "network-vif-plugged", "status": "completed", "tag": "30e678fc-1a8f-4b06-abee-54c719d1e99a"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-b2eeed88-0eff-47a7-9201-bb5af2048185 req-44da7d04-5d36-4fd2-8237-eb29e3bf6c48 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-b2eeed88-0eff-47a7-9201-bb5af2048185 req-44da7d04-5d36-4fd2-8237-eb29e3bf6c48 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-b2eeed88-0eff-47a7-9201-bb5af2048185 req-44da7d04-5d36-4fd2-8237-eb29e3bf6c48 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:40 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-b2eeed88-0eff-47a7-9201-bb5af2048185 req-44da7d04-5d36-4fd2-8237-eb29e3bf6c48 service nova] Creating event network-vif-plugged:30e678fc-1a8f-4b06-abee-54c719d1e99a for instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f on user Apr 20 15:11:40 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-b2eeed88-0eff-47a7-9201-bb5af2048185 req-44da7d04-5d36-4fd2-8237-eb29e3bf6c48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031387 Apr 20 15:11:40 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 57/165] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:11:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:11:42 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-03c35b2d-deb1-471b-996b-abcce450009a tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:42 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-03c35b2d-deb1-471b-996b-abcce450009a tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: f0ab3cf3-85dc-4f42-b81a-049ced9bac2c] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-03c35b2d-deb1-471b-996b-abcce450009a tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-03c35b2d-deb1-471b-996b-abcce450009a tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-03c35b2d-deb1-471b-996b-abcce450009a tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-03c35b2d-deb1-471b-996b-abcce450009a tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-03c35b2d-deb1-471b-996b-abcce450009a tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-03c35b2d-deb1-471b-996b-abcce450009a tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:42 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:43 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-03c35b2d-deb1-471b-996b-abcce450009a tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9585e756e6464da77a49905348b36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaed885af6443a2b5d13ece323b669a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:11:43 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-03c35b2d-deb1-471b-996b-abcce450009a tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c" status: 200 len: 1496 microversion: 2.1 time: 0.319815 Apr 20 15:11:43 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 55/166] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:42 2023] GET /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c => generated 1496 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] [instance: 22660afa-9082-40e8-9293-82048b1ae755] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:43 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] HTTP exception thrown: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Request method failure captured: Apr 20 15:11:43 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755 HTTP/1.1 Apr 20 15:11:43 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:11:43 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:11:43 user devstack@n-api.service[61508]: Connection: close Apr 20 15:11:43 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:11:43 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:11:43 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:11:43 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:11:43 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVoZzuHO8rzcNNrChFtiOm54AaeLV8T51q-vNSZNfw1rtrgu-GLJfsqzj_h1HAoDmflz_zeXPLs0_1sFvrp3FN2mWIz-7TMxXFweKfY_3CoZkP5QS1oDnYBdQ1XiSKo1hc7rZVvnO_so4h4oSwkAWVIYnvI4WWbvwMSuv7nPv9SOts Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Project-Id: d37fba0ede194eb6998df9fa7230906c Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-929182932 Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d37fba0ede194eb6998df9fa7230906c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d37fba0ede194eb6998df9fa7230906c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d37fba0ede194eb6998df9fa7230906c"}]}] Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-929182932 Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Tenant-Id: d37fba0ede194eb6998df9fa7230906c Apr 20 15:11:43 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-929182932 Apr 20 15:11:43 user devstack@n-api.service[61508]: X-User: tempest-AttachSCSIVolumeTestJSON-929182932-project-member Apr 20 15:11:43 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:11:43 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:11:43 user devstack@n-api.service[61508]: X-User-Id: f284743e682b48cbb1f0a4090b4c6ba3 Apr 20 15:11:43 user devstack@n-api.service[61508]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-929182932-project-member Apr 20 15:11:43 user devstack@n-api.service[61508]: method: > Apr 20 15:11:43 user devstack@n-api.service[61508]: exception: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:43 user devstack@n-api.service[61508]: action_args: {'id': '22660afa-9082-40e8-9293-82048b1ae755'} Apr 20 15:11:43 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:43 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:43 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Returning 404 to user: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:11:43 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-36a9c727-6b80-44c4-95c8-f0a159722b1f tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755" status: 404 len: 111 microversion: 2.1 time: 0.044298 Apr 20 15:11:43 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:43 2023] GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:11:43 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-87cc2c68-5025-4b7e-a5eb-b193e3a5b4c5 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Calling method '.version_select at 0x7fcbb37365f0>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:43 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-87cc2c68-5025-4b7e-a5eb-b193e3a5b4c5 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917611531" status: 202 len: 0 microversion: 2.1 time: 0.028303 Apr 20 15:11:43 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 58/168] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 15:11:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917611531 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:11:44 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:44 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] [instance: 22660afa-9082-40e8-9293-82048b1ae755] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:44 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] HTTP exception thrown: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:44 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Request method failure captured: Apr 20 15:11:44 user devstack@n-api.service[61509]: request: DELETE /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755 HTTP/1.1 Apr 20 15:11:44 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:11:44 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:11:44 user devstack@n-api.service[61509]: Connection: close Apr 20 15:11:44 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:11:44 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:11:44 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:11:44 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:11:44 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVVoZzuHO8rzcNNrChFtiOm54AaeLV8T51q-vNSZNfw1rtrgu-GLJfsqzj_h1HAoDmflz_zeXPLs0_1sFvrp3FN2mWIz-7TMxXFweKfY_3CoZkP5QS1oDnYBdQ1XiSKo1hc7rZVvnO_so4h4oSwkAWVIYnvI4WWbvwMSuv7nPv9SOts Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Project-Id: d37fba0ede194eb6998df9fa7230906c Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-929182932 Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d37fba0ede194eb6998df9fa7230906c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d37fba0ede194eb6998df9fa7230906c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d37fba0ede194eb6998df9fa7230906c"}]}] Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-929182932 Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Tenant-Id: d37fba0ede194eb6998df9fa7230906c Apr 20 15:11:44 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-929182932 Apr 20 15:11:44 user devstack@n-api.service[61509]: X-User: tempest-AttachSCSIVolumeTestJSON-929182932-project-member Apr 20 15:11:44 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:11:44 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:11:44 user devstack@n-api.service[61509]: X-User-Id: f284743e682b48cbb1f0a4090b4c6ba3 Apr 20 15:11:44 user devstack@n-api.service[61509]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-929182932-project-member Apr 20 15:11:44 user devstack@n-api.service[61509]: method: > Apr 20 15:11:44 user devstack@n-api.service[61509]: exception: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:44 user devstack@n-api.service[61509]: action_args: {'id': '22660afa-9082-40e8-9293-82048b1ae755'} Apr 20 15:11:44 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:44 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:11:44 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Returning 404 to user: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:11:44 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-188cccc3-c066-45cb-859e-d5c9c91e9a71 tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755" status: 404 len: 111 microversion: 2.1 time: 0.035987 Apr 20 15:11:44 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 56/169] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:11:44 2023] DELETE /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:11:44 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:44 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] [instance: 22660afa-9082-40e8-9293-82048b1ae755] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:44 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] HTTP exception thrown: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:44 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Request method failure captured: Apr 20 15:11:44 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755 HTTP/1.1 Apr 20 15:11:44 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:11:44 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:11:44 user devstack@n-api.service[61508]: Connection: close Apr 20 15:11:44 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:11:44 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:11:44 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:11:44 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:11:44 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVoZzuHO8rzcNNrChFtiOm54AaeLV8T51q-vNSZNfw1rtrgu-GLJfsqzj_h1HAoDmflz_zeXPLs0_1sFvrp3FN2mWIz-7TMxXFweKfY_3CoZkP5QS1oDnYBdQ1XiSKo1hc7rZVvnO_so4h4oSwkAWVIYnvI4WWbvwMSuv7nPv9SOts Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Project-Id: d37fba0ede194eb6998df9fa7230906c Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-929182932 Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d37fba0ede194eb6998df9fa7230906c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d37fba0ede194eb6998df9fa7230906c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d37fba0ede194eb6998df9fa7230906c"}]}] Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-929182932 Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Tenant-Id: d37fba0ede194eb6998df9fa7230906c Apr 20 15:11:44 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-929182932 Apr 20 15:11:44 user devstack@n-api.service[61508]: X-User: tempest-AttachSCSIVolumeTestJSON-929182932-project-member Apr 20 15:11:44 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:11:44 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:11:44 user devstack@n-api.service[61508]: X-User-Id: f284743e682b48cbb1f0a4090b4c6ba3 Apr 20 15:11:44 user devstack@n-api.service[61508]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-929182932-project-member Apr 20 15:11:44 user devstack@n-api.service[61508]: method: > Apr 20 15:11:44 user devstack@n-api.service[61508]: exception: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:44 user devstack@n-api.service[61508]: action_args: {'id': '22660afa-9082-40e8-9293-82048b1ae755'} Apr 20 15:11:44 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. Apr 20 15:11:44 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:11:44 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] Returning 404 to user: Instance 22660afa-9082-40e8-9293-82048b1ae755 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:11:44 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-c33f4784-6208-4f0e-a7f5-fc5d5aa0fc1d tempest-AttachSCSIVolumeTestJSON-929182932 tempest-AttachSCSIVolumeTestJSON-929182932-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755" status: 404 len: 111 microversion: 2.1 time: 0.030292 Apr 20 15:11:44 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 56/170] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:44 2023] GET /compute/v2.1/servers/22660afa-9082-40e8-9293-82048b1ae755 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=18 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1902513497", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "networks": [{"uuid": "eae4c926-7ab7-4aff-8540-b52a43d1662c"}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] validate_networks() for [('eae4c926-7ab7-4aff-8540-b52a43d1662c', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Getting quotas for project 7452508975f646dc9998777965d2c9dc. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Getting quotas for user cd69e3cd8e2b4e89916785ae929558c8 and project 7452508975f646dc9998777965d2c9dc. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:11:56 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] [instance: 12403233-648f-4d8b-aeaf-039340a8cbae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:11:56 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-13493ec4-fc6c-4283-a0a1-d5b494bf5703 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.664578 Apr 20 15:11:56 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 59/171] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:11:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:11:56 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-2eac8ddc-cfbb-4985-bd69-592166ac6b44 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:11:56 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-2eac8ddc-cfbb-4985-bd69-592166ac6b44 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] [instance: 12403233-648f-4d8b-aeaf-039340a8cbae] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:11:56 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=8 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:56 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:56 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=22 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:11:56 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-2eac8ddc-cfbb-4985-bd69-592166ac6b44 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69e3cd8e2b4e89916785ae929558c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7452508975f646dc9998777965d2c9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:11:57 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-2eac8ddc-cfbb-4985-bd69-592166ac6b44 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae" status: 200 len: 1208 microversion: 2.1 time: 0.080254 Apr 20 15:11:57 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 57/172] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:11:56 2023] GET /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae => generated 1208 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:12:01 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-1e3f183a-7286-44ba-8260-eb3c88e55ed2 req-3a213453-cca4-4821-9e53-ce57b3207980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12403233-648f-4d8b-aeaf-039340a8cbae", "tag": "71a59558-2e91-4d33-802c-55d86e1efb44"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:01 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:01 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=8 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:01 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-1e3f183a-7286-44ba-8260-eb3c88e55ed2 req-3a213453-cca4-4821-9e53-ce57b3207980 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:01 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-1e3f183a-7286-44ba-8260-eb3c88e55ed2 req-3a213453-cca4-4821-9e53-ce57b3207980 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:01 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-1e3f183a-7286-44ba-8260-eb3c88e55ed2 req-3a213453-cca4-4821-9e53-ce57b3207980 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:01 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-1e3f183a-7286-44ba-8260-eb3c88e55ed2 req-3a213453-cca4-4821-9e53-ce57b3207980 service nova] Creating event network-changed:71a59558-2e91-4d33-802c-55d86e1efb44 for instance 12403233-648f-4d8b-aeaf-039340a8cbae on user Apr 20 15:12:01 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-1e3f183a-7286-44ba-8260-eb3c88e55ed2 req-3a213453-cca4-4821-9e53-ce57b3207980 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042417 Apr 20 15:12:01 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 57/173] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:12:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:12:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-9d71739b-aa1b-46e7-bf6b-b7f64a7bcdaa req-4efed22a-58ca-4ec2-8061-c51cef916aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12403233-648f-4d8b-aeaf-039340a8cbae", "name": "network-vif-plugged", "status": "completed", "tag": "71a59558-2e91-4d33-802c-55d86e1efb44"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-9d71739b-aa1b-46e7-bf6b-b7f64a7bcdaa req-4efed22a-58ca-4ec2-8061-c51cef916aa2 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-9d71739b-aa1b-46e7-bf6b-b7f64a7bcdaa req-4efed22a-58ca-4ec2-8061-c51cef916aa2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-9d71739b-aa1b-46e7-bf6b-b7f64a7bcdaa req-4efed22a-58ca-4ec2-8061-c51cef916aa2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-9d71739b-aa1b-46e7-bf6b-b7f64a7bcdaa req-4efed22a-58ca-4ec2-8061-c51cef916aa2 service nova] Creating event network-vif-plugged:71a59558-2e91-4d33-802c-55d86e1efb44 for instance 12403233-648f-4d8b-aeaf-039340a8cbae on user Apr 20 15:12:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-9d71739b-aa1b-46e7-bf6b-b7f64a7bcdaa req-4efed22a-58ca-4ec2-8061-c51cef916aa2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041453 Apr 20 15:12:04 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 60/174] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:12:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:12:06 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-aeade298-e8b7-4252-8fe3-d57770f3e445 req-f0e733a9-150a-4951-86b0-598157c0e694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12403233-648f-4d8b-aeaf-039340a8cbae", "name": "network-vif-plugged", "status": "completed", "tag": "71a59558-2e91-4d33-802c-55d86e1efb44"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-aeade298-e8b7-4252-8fe3-d57770f3e445 req-f0e733a9-150a-4951-86b0-598157c0e694 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-aeade298-e8b7-4252-8fe3-d57770f3e445 req-f0e733a9-150a-4951-86b0-598157c0e694 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-aeade298-e8b7-4252-8fe3-d57770f3e445 req-f0e733a9-150a-4951-86b0-598157c0e694 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:06 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-aeade298-e8b7-4252-8fe3-d57770f3e445 req-f0e733a9-150a-4951-86b0-598157c0e694 service nova] Creating event network-vif-plugged:71a59558-2e91-4d33-802c-55d86e1efb44 for instance 12403233-648f-4d8b-aeaf-039340a8cbae on user Apr 20 15:12:06 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-aeade298-e8b7-4252-8fe3-d57770f3e445 req-f0e733a9-150a-4951-86b0-598157c0e694 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052050 Apr 20 15:12:06 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 58/175] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:12:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:12:07 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-a2446048-ad60-47ae-9d93-4dc2dc999d9e tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:07 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-a2446048-ad60-47ae-9d93-4dc2dc999d9e tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: c62c36e6-6410-4f7d-9968-e0e7bded79fc] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-a2446048-ad60-47ae-9d93-4dc2dc999d9e tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-a2446048-ad60-47ae-9d93-4dc2dc999d9e tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-a2446048-ad60-47ae-9d93-4dc2dc999d9e tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-a2446048-ad60-47ae-9d93-4dc2dc999d9e tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-a2446048-ad60-47ae-9d93-4dc2dc999d9e tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-a2446048-ad60-47ae-9d93-4dc2dc999d9e tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:07 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-a2446048-ad60-47ae-9d93-4dc2dc999d9e tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515a83630b834f03a4fd748fb75b3550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d2444339049d0a0bb680f55ce75e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:07 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-a2446048-ad60-47ae-9d93-4dc2dc999d9e tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc" status: 200 len: 1494 microversion: 2.1 time: 0.267003 Apr 20 15:12:07 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:12:07 2023] GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc => generated 1494 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-8be4094e-6523-4f1d-bcc3-031283b7a636 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-8be4094e-6523-4f1d-bcc3-031283b7a636 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4094e-6523-4f1d-bcc3-031283b7a636 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4094e-6523-4f1d-bcc3-031283b7a636 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4094e-6523-4f1d-bcc3-031283b7a636 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4094e-6523-4f1d-bcc3-031283b7a636 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4094e-6523-4f1d-bcc3-031283b7a636 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4094e-6523-4f1d-bcc3-031283b7a636 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:23 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-8be4094e-6523-4f1d-bcc3-031283b7a636 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca4ca64cede4846a74e2cc4c13f3c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb81196155147cea0569f8a96465b6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:23 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-8be4094e-6523-4f1d-bcc3-031283b7a636 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f" status: 200 len: 1545 microversion: 2.1 time: 0.246876 Apr 20 15:12:23 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 61/177] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:12:23 2023] GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f => generated 1545 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-451dc3d0-9eb9-43b9-8122-8be4d16d98f2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-451dc3d0-9eb9-43b9-8122-8be4d16d98f2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-451dc3d0-9eb9-43b9-8122-8be4d16d98f2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-451dc3d0-9eb9-43b9-8122-8be4d16d98f2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-451dc3d0-9eb9-43b9-8122-8be4d16d98f2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-451dc3d0-9eb9-43b9-8122-8be4d16d98f2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-451dc3d0-9eb9-43b9-8122-8be4d16d98f2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-451dc3d0-9eb9-43b9-8122-8be4d16d98f2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:24 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-451dc3d0-9eb9-43b9-8122-8be4d16d98f2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e0c347919c4f92bca310629130038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784602eedf114b789cbe062a0f4d8654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:24 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-451dc3d0-9eb9-43b9-8122-8be4d16d98f2 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858" status: 200 len: 1672 microversion: 2.1 time: 0.220033 Apr 20 15:12:24 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 59/178] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:12:24 2023] GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858 => generated 1672 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=8 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG nova.objects.instance [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lazy-loading 'fault' on Instance uuid f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd {{(pid=61508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:25 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:25 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-f72e432a-02e0-482e-b5cb-791eca8a99ec tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd" status: 200 len: 1649 microversion: 2.87 time: 0.113078 Apr 20 15:12:25 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 59/179] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:12:25 2023] GET /compute/v2.1/servers/f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd => generated 1649 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] Doing local delete in cell c9259cc4-6390-40ae-86fb-bec94ff13c9d(cell1) {{(pid=61510) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:25 user devstack@n-api.service[61510]: WARNING nova.compute.api [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] instance's host None is down, deleting from database Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] deallocate_for_instance() {{(pid=61510) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] Instance cache missing network info. {{(pid=61510) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] Updating instance_info_cache with network_info: [] {{(pid=61510) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 15:12:25 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61510) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 15:12:25 user devstack@n-api.service[61510]: WARNING nova.compute.api [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 15:12:25 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-f75745ff-d396-4a42-bfc1-de9959f2986b tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '.version_select at 0x7fcbb3753ac0>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:26 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-f75745ff-d396-4a42-bfc1-de9959f2986b tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/4eb2f39f-b427-4a52-9120-58df06c83d1d" status: 204 len: 0 microversion: 2.1 time: 0.219243 Apr 20 15:12:26 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 60/180] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:12:25 2023] DELETE /compute/v2.1/images/4eb2f39f-b427-4a52-9120-58df06c83d1d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-641c3941-19e9-4508-b78c-9792a99acb31 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-641c3941-19e9-4508-b78c-9792a99acb31 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-641c3941-19e9-4508-b78c-9792a99acb31 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-641c3941-19e9-4508-b78c-9792a99acb31 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-641c3941-19e9-4508-b78c-9792a99acb31 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-641c3941-19e9-4508-b78c-9792a99acb31 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-641c3941-19e9-4508-b78c-9792a99acb31 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-641c3941-19e9-4508-b78c-9792a99acb31 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-641c3941-19e9-4508-b78c-9792a99acb31 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] Going to try to terminate instance {{(pid=61508) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:12:26 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-a6d1674d-40de-48b2-9036-575877b04646 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd" status: 204 len: 0 microversion: 2.87 time: 0.598823 Apr 20 15:12:26 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 62/181] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 15:12:25 2023] DELETE /compute/v2.1/servers/f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:26 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-641c3941-19e9-4508-b78c-9792a99acb31 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858" status: 204 len: 0 microversion: 2.1 time: 0.116959 Apr 20 15:12:26 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 60/182] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:12:26 2023] DELETE /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:26 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-73d2a5e3-7f55-4ba5-ab5a-f34f33fc4365 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:26 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-73d2a5e3-7f55-4ba5-ab5a-f34f33fc4365 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73d2a5e3-7f55-4ba5-ab5a-f34f33fc4365 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73d2a5e3-7f55-4ba5-ab5a-f34f33fc4365 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73d2a5e3-7f55-4ba5-ab5a-f34f33fc4365 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73d2a5e3-7f55-4ba5-ab5a-f34f33fc4365 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73d2a5e3-7f55-4ba5-ab5a-f34f33fc4365 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-73d2a5e3-7f55-4ba5-ab5a-f34f33fc4365 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:26 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] HTTP exception thrown: Instance f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd could not be found. Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Request method failure captured: Apr 20 15:12:26 user devstack@n-api.service[61509]: request: GET /compute/v2.1/servers/f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd HTTP/1.1 Apr 20 15:12:26 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:12:26 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:12:26 user devstack@n-api.service[61509]: Connection: close Apr 20 15:12:26 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:12:26 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:12:26 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:12:26 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:12:26 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVVxifQhLh6haZF7OFMEa88rkO6musJzeutvw2tGr_aikmEOjg3pT-FNBOBwV498YHXxBJNjACcf12tEqz13zia3YO4cAGgfSGjJy_X1uYy36PSb-JYgh5guqGDK74Mv9iFGBgvQBtW5DMlIiMoqOYP6W54wS58GKKB1FquD3E95S_E Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Project-Id: b53c73dfc9094d05802c05b2f25d6bed Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53c73dfc9094d05802c05b2f25d6bed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53c73dfc9094d05802c05b2f25d6bed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b53c73dfc9094d05802c05b2f25d6bed"}]}] Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Tenant-Id: b53c73dfc9094d05802c05b2f25d6bed Apr 20 15:12:26 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:12:26 user devstack@n-api.service[61509]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member Apr 20 15:12:26 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:12:26 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:12:26 user devstack@n-api.service[61509]: X-User-Id: f19d8fcc1b69479992ff0d8bc5c99306 Apr 20 15:12:26 user devstack@n-api.service[61509]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member Apr 20 15:12:26 user devstack@n-api.service[61509]: method: > Apr 20 15:12:26 user devstack@n-api.service[61509]: exception: Instance f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd could not be found. Apr 20 15:12:26 user devstack@n-api.service[61509]: action_args: {'id': 'f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd'} Apr 20 15:12:26 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd could not be found. Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd could not be found. Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd could not be found. Apr 20 15:12:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Returning 404 to user: Instance f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:12:26 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-999ccb4a-79b3-46ae-ad06-afa0af7c6842 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd" status: 404 len: 111 microversion: 2.87 time: 0.035237 Apr 20 15:12:26 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 61/183] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:12:26 2023] GET /compute/v2.1/servers/f22db0bf-5f95-4093-ac7e-fcbe5d29d2cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1033209679", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "networks": [{"uuid": "3626f883-4d6a-49ba-95ea-b76718169d69"}]}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.network.neutron [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] validate_networks() for [('3626f883-4d6a-49ba-95ea-b76718169d69', None, None, None, None, None)] {{(pid=61508) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-178b8a0f-6d39-4c6d-8346-f9e2fadce74b req-3ab7894a-2ec2-4524-9eba-3d1e9465e7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43cea1ab-3ddc-401d-97b3-3721808e2858", "name": "network-vif-unplugged", "status": "completed", "tag": "a371311c-f46e-4115-9490-5fb33d90dcd4"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-178b8a0f-6d39-4c6d-8346-f9e2fadce74b req-3ab7894a-2ec2-4524-9eba-3d1e9465e7c9 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-178b8a0f-6d39-4c6d-8346-f9e2fadce74b req-3ab7894a-2ec2-4524-9eba-3d1e9465e7c9 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-178b8a0f-6d39-4c6d-8346-f9e2fadce74b req-3ab7894a-2ec2-4524-9eba-3d1e9465e7c9 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:26 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-178b8a0f-6d39-4c6d-8346-f9e2fadce74b req-3ab7894a-2ec2-4524-9eba-3d1e9465e7c9 service nova] Creating event network-vif-unplugged:a371311c-f46e-4115-9490-5fb33d90dcd4 for instance 43cea1ab-3ddc-401d-97b3-3721808e2858 on user Apr 20 15:12:26 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-178b8a0f-6d39-4c6d-8346-f9e2fadce74b req-3ab7894a-2ec2-4524-9eba-3d1e9465e7c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036610 Apr 20 15:12:26 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 62/184] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:12:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:12:26 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-73d2a5e3-7f55-4ba5-ab5a-f34f33fc4365 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e0c347919c4f92bca310629130038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784602eedf114b789cbe062a0f4d8654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:26 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-73d2a5e3-7f55-4ba5-ab5a-f34f33fc4365 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858" status: 200 len: 1678 microversion: 2.1 time: 0.332531 Apr 20 15:12:26 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 63/185] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:12:26 2023] GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858 => generated 1678 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Flavor limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Image limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Flavor pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Image pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Getting quotas for project b53c73dfc9094d05802c05b2f25d6bed. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Getting quotas for user f19d8fcc1b69479992ff0d8bc5c99306 and project b53c73dfc9094d05802c05b2f25d6bed. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Going to run 1 instances... {{(pid=61508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:12:26 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: a41b61b3-ec9a-492b-b137-95e320dee7d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:12:27 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-ea3169c2-7775-4900-a0c8-5c64b00243d7 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.570137 Apr 20 15:12:27 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 61/186] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 15:12:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 15:12:27 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-5ac6bf4a-6d43-4c40-b7fe-b27d4a9d1d21 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:27 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-5ac6bf4a-6d43-4c40-b7fe-b27d4a9d1d21 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: a41b61b3-ec9a-492b-b137-95e320dee7d1] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:27 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-5ac6bf4a-6d43-4c40-b7fe-b27d4a9d1d21 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:27 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-5ac6bf4a-6d43-4c40-b7fe-b27d4a9d1d21 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:27 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-5ac6bf4a-6d43-4c40-b7fe-b27d4a9d1d21 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:27 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-5ac6bf4a-6d43-4c40-b7fe-b27d4a9d1d21 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1" status: 200 len: 1395 microversion: 2.87 time: 0.079728 Apr 20 15:12:27 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 63/187] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:12:27 2023] GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1 => generated 1395 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:12:28 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-255042d6-cd76-4e19-959d-a5a5739dd609 req-88e46fe1-c0b8-4c56-88b3-e17c364c1d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43cea1ab-3ddc-401d-97b3-3721808e2858", "name": "network-vif-plugged", "status": "completed", "tag": "a371311c-f46e-4115-9490-5fb33d90dcd4"}, {"server_uuid": "43cea1ab-3ddc-401d-97b3-3721808e2858", "name": "network-vif-deleted", "tag": "a371311c-f46e-4115-9490-5fb33d90dcd4"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-255042d6-cd76-4e19-959d-a5a5739dd609 req-88e46fe1-c0b8-4c56-88b3-e17c364c1d34 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-255042d6-cd76-4e19-959d-a5a5739dd609 req-88e46fe1-c0b8-4c56-88b3-e17c364c1d34 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-255042d6-cd76-4e19-959d-a5a5739dd609 req-88e46fe1-c0b8-4c56-88b3-e17c364c1d34 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:28 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-255042d6-cd76-4e19-959d-a5a5739dd609 req-88e46fe1-c0b8-4c56-88b3-e17c364c1d34 service nova] Creating event network-vif-plugged:a371311c-f46e-4115-9490-5fb33d90dcd4 for instance 43cea1ab-3ddc-401d-97b3-3721808e2858 on user Apr 20 15:12:28 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-255042d6-cd76-4e19-959d-a5a5739dd609 req-88e46fe1-c0b8-4c56-88b3-e17c364c1d34 service nova] Creating event network-vif-deleted:a371311c-f46e-4115-9490-5fb33d90dcd4 for instance 43cea1ab-3ddc-401d-97b3-3721808e2858 on user Apr 20 15:12:28 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-255042d6-cd76-4e19-959d-a5a5739dd609 req-88e46fe1-c0b8-4c56-88b3-e17c364c1d34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044412 Apr 20 15:12:28 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 64/188] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:12:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:12:30 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-8e602032-76b5-4939-8c22-e31a4c127528 req-51b58d02-3265-4c90-b319-31c6aac5dcbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41b61b3-ec9a-492b-b137-95e320dee7d1", "tag": "b2623ec3-1a33-4c90-9e40-1f8298bbba37"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:30 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-8e602032-76b5-4939-8c22-e31a4c127528 req-51b58d02-3265-4c90-b319-31c6aac5dcbf service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:30 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-8e602032-76b5-4939-8c22-e31a4c127528 req-51b58d02-3265-4c90-b319-31c6aac5dcbf service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:30 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-8e602032-76b5-4939-8c22-e31a4c127528 req-51b58d02-3265-4c90-b319-31c6aac5dcbf service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:30 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-8e602032-76b5-4939-8c22-e31a4c127528 req-51b58d02-3265-4c90-b319-31c6aac5dcbf service nova] Creating event network-changed:b2623ec3-1a33-4c90-9e40-1f8298bbba37 for instance a41b61b3-ec9a-492b-b137-95e320dee7d1 on user Apr 20 15:12:30 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-8e602032-76b5-4939-8c22-e31a4c127528 req-51b58d02-3265-4c90-b319-31c6aac5dcbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028496 Apr 20 15:12:30 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 62/189] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:12:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:12:31 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-7366baec-f103-439c-b91b-1b48fd29851b tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:31 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-7366baec-f103-439c-b91b-1b48fd29851b tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:31 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7366baec-f103-439c-b91b-1b48fd29851b tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:31 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7366baec-f103-439c-b91b-1b48fd29851b tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:31 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7366baec-f103-439c-b91b-1b48fd29851b tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:31 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7366baec-f103-439c-b91b-1b48fd29851b tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:31 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7366baec-f103-439c-b91b-1b48fd29851b tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:31 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7366baec-f103-439c-b91b-1b48fd29851b tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:32 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-7366baec-f103-439c-b91b-1b48fd29851b tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:32 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-7366baec-f103-439c-b91b-1b48fd29851b tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.253602 Apr 20 15:12:32 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 64/190] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:12:31 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:12:32 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-aa5f35cd-6853-40a5-a644-d9312c290ffc req-fb33083c-b7ae-4a34-8d7d-0f74e2dc580d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41b61b3-ec9a-492b-b137-95e320dee7d1", "name": "network-vif-plugged", "status": "completed", "tag": "b2623ec3-1a33-4c90-9e40-1f8298bbba37"}, {"server_uuid": "a41b61b3-ec9a-492b-b137-95e320dee7d1", "name": "network-vif-plugged", "status": "completed", "tag": "b2623ec3-1a33-4c90-9e40-1f8298bbba37"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-aa5f35cd-6853-40a5-a644-d9312c290ffc req-fb33083c-b7ae-4a34-8d7d-0f74e2dc580d service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-aa5f35cd-6853-40a5-a644-d9312c290ffc req-fb33083c-b7ae-4a34-8d7d-0f74e2dc580d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-aa5f35cd-6853-40a5-a644-d9312c290ffc req-fb33083c-b7ae-4a34-8d7d-0f74e2dc580d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-aa5f35cd-6853-40a5-a644-d9312c290ffc req-fb33083c-b7ae-4a34-8d7d-0f74e2dc580d service nova] Creating event network-vif-plugged:b2623ec3-1a33-4c90-9e40-1f8298bbba37 for instance a41b61b3-ec9a-492b-b137-95e320dee7d1 on user Apr 20 15:12:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-aa5f35cd-6853-40a5-a644-d9312c290ffc req-fb33083c-b7ae-4a34-8d7d-0f74e2dc580d service nova] Creating event network-vif-plugged:b2623ec3-1a33-4c90-9e40-1f8298bbba37 for instance a41b61b3-ec9a-492b-b137-95e320dee7d1 on user Apr 20 15:12:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-aa5f35cd-6853-40a5-a644-d9312c290ffc req-fb33083c-b7ae-4a34-8d7d-0f74e2dc580d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034355 Apr 20 15:12:32 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 65/191] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:12:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-b1777261-9c2f-4feb-acd4-0a3352c16034 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-b1777261-9c2f-4feb-acd4-0a3352c16034 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: f0ab3cf3-85dc-4f42-b81a-049ced9bac2c] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b1777261-9c2f-4feb-acd4-0a3352c16034 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b1777261-9c2f-4feb-acd4-0a3352c16034 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b1777261-9c2f-4feb-acd4-0a3352c16034 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b1777261-9c2f-4feb-acd4-0a3352c16034 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b1777261-9c2f-4feb-acd4-0a3352c16034 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b1777261-9c2f-4feb-acd4-0a3352c16034 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:44 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-b1777261-9c2f-4feb-acd4-0a3352c16034 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: f0ab3cf3-85dc-4f42-b81a-049ced9bac2c] Going to try to terminate instance {{(pid=61508) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:12:44 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-b1777261-9c2f-4feb-acd4-0a3352c16034 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c" status: 204 len: 0 microversion: 2.1 time: 0.133088 Apr 20 15:12:44 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 63/192] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:12:44 2023] DELETE /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-7c61da02-ee35-4e77-9e7c-d78e1df538fb tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-7c61da02-ee35-4e77-9e7c-d78e1df538fb tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: f0ab3cf3-85dc-4f42-b81a-049ced9bac2c] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=14 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=16 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7c61da02-ee35-4e77-9e7c-d78e1df538fb tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7c61da02-ee35-4e77-9e7c-d78e1df538fb tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7c61da02-ee35-4e77-9e7c-d78e1df538fb tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7c61da02-ee35-4e77-9e7c-d78e1df538fb tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7c61da02-ee35-4e77-9e7c-d78e1df538fb tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7c61da02-ee35-4e77-9e7c-d78e1df538fb tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:44 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:44 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:12:44 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-9a18012f-230b-4194-8bb8-3f5694d504d6 req-977740ef-3e5e-4e88-927a-c8c1e8949549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ab3cf3-85dc-4f42-b81a-049ced9bac2c", "name": "network-vif-unplugged", "status": "completed", "tag": "1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-9a18012f-230b-4194-8bb8-3f5694d504d6 req-977740ef-3e5e-4e88-927a-c8c1e8949549 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-9a18012f-230b-4194-8bb8-3f5694d504d6 req-977740ef-3e5e-4e88-927a-c8c1e8949549 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-9a18012f-230b-4194-8bb8-3f5694d504d6 req-977740ef-3e5e-4e88-927a-c8c1e8949549 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:44 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-9a18012f-230b-4194-8bb8-3f5694d504d6 req-977740ef-3e5e-4e88-927a-c8c1e8949549 service nova] Creating event network-vif-unplugged:1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867 for instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c on user Apr 20 15:12:44 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-9a18012f-230b-4194-8bb8-3f5694d504d6 req-977740ef-3e5e-4e88-927a-c8c1e8949549 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042191 Apr 20 15:12:44 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 66/193] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:12:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:12:45 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-7c61da02-ee35-4e77-9e7c-d78e1df538fb tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9585e756e6464da77a49905348b36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaed885af6443a2b5d13ece323b669a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:45 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-7c61da02-ee35-4e77-9e7c-d78e1df538fb tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c" status: 200 len: 1502 microversion: 2.1 time: 0.345850 Apr 20 15:12:45 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:12:44 2023] GET /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c => generated 1502 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:12:45 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-baf4c74e-ddb9-4ad9-a8aa-9cfbcd433bba tempest-TestVolumeBootPattern-898721844 tempest-TestVolumeBootPattern-898721844-project-member] Action: 'create', calling method: .version_select at 0x7fcbb37a5c60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2109715298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfBe5I7a932GZ5LFQtfozpDuBBid4FQwAJDGQAiTDQhWagLXq6XJkYGMUVo1maZYGKz5RQlrcIefN68xHQA5nx9//5GAZTtM+pzp9DHhD3kpBwrzK7JpQDggqmRAceGEw=="}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:45 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-baf4c74e-ddb9-4ad9-a8aa-9cfbcd433bba tempest-TestVolumeBootPattern-898721844 tempest-TestVolumeBootPattern-898721844-project-member] Getting quotas for project 7b2a1ac8888c4d6f8c5ccaf201b6a6fb. Resources: {'key_pairs'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:12:45 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-baf4c74e-ddb9-4ad9-a8aa-9cfbcd433bba tempest-TestVolumeBootPattern-898721844 tempest-TestVolumeBootPattern-898721844-project-member] Getting quotas for user dc018fbbe7564485b15602a6b7fba1d1 and project 7b2a1ac8888c4d6f8c5ccaf201b6a6fb. Resources: {'key_pairs'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:12:45 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-baf4c74e-ddb9-4ad9-a8aa-9cfbcd433bba tempest-TestVolumeBootPattern-898721844 tempest-TestVolumeBootPattern-898721844-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.044688 Apr 20 15:12:45 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 64/195] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:12:45 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:12:47 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-14df7c9f-12fc-4514-ab32-829789a0566f req-39a25ac1-9a5a-4b08-860c-6a3adef4f31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ab3cf3-85dc-4f42-b81a-049ced9bac2c", "name": "network-vif-plugged", "status": "completed", "tag": "1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867"}, {"server_uuid": "f0ab3cf3-85dc-4f42-b81a-049ced9bac2c", "name": "network-vif-deleted", "tag": "1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:12:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-14df7c9f-12fc-4514-ab32-829789a0566f req-39a25ac1-9a5a-4b08-860c-6a3adef4f31d service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-14df7c9f-12fc-4514-ab32-829789a0566f req-39a25ac1-9a5a-4b08-860c-6a3adef4f31d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-14df7c9f-12fc-4514-ab32-829789a0566f req-39a25ac1-9a5a-4b08-860c-6a3adef4f31d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:47 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-14df7c9f-12fc-4514-ab32-829789a0566f req-39a25ac1-9a5a-4b08-860c-6a3adef4f31d service nova] Creating event network-vif-plugged:1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867 for instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c on user Apr 20 15:12:47 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-14df7c9f-12fc-4514-ab32-829789a0566f req-39a25ac1-9a5a-4b08-860c-6a3adef4f31d service nova] Creating event network-vif-deleted:1d2bfac4-45b1-4ab3-ae0b-0d3b5a3fe867 for instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c on user Apr 20 15:12:47 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-0fb1bcab-5524-4332-8326-95620ae65374 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:47 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-14df7c9f-12fc-4514-ab32-829789a0566f req-39a25ac1-9a5a-4b08-860c-6a3adef4f31d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035430 Apr 20 15:12:47 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-0fb1bcab-5524-4332-8326-95620ae65374 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] [instance: 12403233-648f-4d8b-aeaf-039340a8cbae] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:12:47 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 67/196] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:12:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:12:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0fb1bcab-5524-4332-8326-95620ae65374 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0fb1bcab-5524-4332-8326-95620ae65374 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0fb1bcab-5524-4332-8326-95620ae65374 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0fb1bcab-5524-4332-8326-95620ae65374 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:12:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0fb1bcab-5524-4332-8326-95620ae65374 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:12:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0fb1bcab-5524-4332-8326-95620ae65374 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:12:47 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-0fb1bcab-5524-4332-8326-95620ae65374 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69e3cd8e2b4e89916785ae929558c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7452508975f646dc9998777965d2c9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:12:47 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-0fb1bcab-5524-4332-8326-95620ae65374 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae" status: 200 len: 1486 microversion: 2.1 time: 0.238880 Apr 20 15:12:47 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:12:47 2023] GET /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae => generated 1486 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:12:48 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-16d3ec7c-f072-4b14-a0e7-61352c3d5080 tempest-TestVolumeBootPattern-898721844 tempest-TestVolumeBootPattern-898721844-project-member] Calling method '.version_select at 0x7fcbb36103a0>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:12:48 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-16d3ec7c-f072-4b14-a0e7-61352c3d5080 tempest-TestVolumeBootPattern-898721844 tempest-TestVolumeBootPattern-898721844-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2109715298" status: 202 len: 0 microversion: 2.1 time: 0.026116 Apr 20 15:12:48 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 65/198] 10.0.0.210 () {62 vars in 1340 bytes} [Thu Apr 20 15:12:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2109715298 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ee81063e-0e23-4043-a6cb-b3fae46890bd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ee81063e-0e23-4043-a6cb-b3fae46890bd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: c62c36e6-6410-4f7d-9968-e0e7bded79fc] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ee81063e-0e23-4043-a6cb-b3fae46890bd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ee81063e-0e23-4043-a6cb-b3fae46890bd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ee81063e-0e23-4043-a6cb-b3fae46890bd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ee81063e-0e23-4043-a6cb-b3fae46890bd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ee81063e-0e23-4043-a6cb-b3fae46890bd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ee81063e-0e23-4043-a6cb-b3fae46890bd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:07 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ee81063e-0e23-4043-a6cb-b3fae46890bd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: c62c36e6-6410-4f7d-9968-e0e7bded79fc] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:13:08 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-ee81063e-0e23-4043-a6cb-b3fae46890bd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc" status: 204 len: 0 microversion: 2.1 time: 0.133121 Apr 20 15:13:08 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 68/199] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:13:07 2023] DELETE /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=4 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=12 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-5d819443-19fc-4ee5-a51a-e1aa9530ac74 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-5d819443-19fc-4ee5-a51a-e1aa9530ac74 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: c62c36e6-6410-4f7d-9968-e0e7bded79fc] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5d819443-19fc-4ee5-a51a-e1aa9530ac74 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5d819443-19fc-4ee5-a51a-e1aa9530ac74 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5d819443-19fc-4ee5-a51a-e1aa9530ac74 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5d819443-19fc-4ee5-a51a-e1aa9530ac74 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5d819443-19fc-4ee5-a51a-e1aa9530ac74 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5d819443-19fc-4ee5-a51a-e1aa9530ac74 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:08 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:08 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:08 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:08 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-15d8f2e5-8958-48cf-85d9-c43fa12cd77c req-1e06e851-73ea-4d0b-bbd5-6100b8788bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62c36e6-6410-4f7d-9968-e0e7bded79fc", "name": "network-vif-unplugged", "status": "completed", "tag": "e8ff5f7f-a025-473b-9ba7-9f46f52eb040"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:08 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-15d8f2e5-8958-48cf-85d9-c43fa12cd77c req-1e06e851-73ea-4d0b-bbd5-6100b8788bad service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:08 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-15d8f2e5-8958-48cf-85d9-c43fa12cd77c req-1e06e851-73ea-4d0b-bbd5-6100b8788bad service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:08 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-15d8f2e5-8958-48cf-85d9-c43fa12cd77c req-1e06e851-73ea-4d0b-bbd5-6100b8788bad service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:08 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-15d8f2e5-8958-48cf-85d9-c43fa12cd77c req-1e06e851-73ea-4d0b-bbd5-6100b8788bad service nova] Creating event network-vif-unplugged:e8ff5f7f-a025-473b-9ba7-9f46f52eb040 for instance c62c36e6-6410-4f7d-9968-e0e7bded79fc on user Apr 20 15:13:08 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-15d8f2e5-8958-48cf-85d9-c43fa12cd77c req-1e06e851-73ea-4d0b-bbd5-6100b8788bad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065552 Apr 20 15:13:08 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 66/200] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:08 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-5d819443-19fc-4ee5-a51a-e1aa9530ac74 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515a83630b834f03a4fd748fb75b3550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d2444339049d0a0bb680f55ce75e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:08 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-5d819443-19fc-4ee5-a51a-e1aa9530ac74 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc" status: 200 len: 1500 microversion: 2.1 time: 0.356310 Apr 20 15:13:08 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:08 2023] GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc => generated 1500 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:13:10 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-a094a7d7-d9fa-464e-ab97-bb763f651c4d req-768ba3d2-8b3f-48da-bfd7-db519dc488f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62c36e6-6410-4f7d-9968-e0e7bded79fc", "name": "network-vif-plugged", "status": "completed", "tag": "e8ff5f7f-a025-473b-9ba7-9f46f52eb040"}, {"server_uuid": "c62c36e6-6410-4f7d-9968-e0e7bded79fc", "name": "network-vif-plugged", "status": "completed", "tag": "e8ff5f7f-a025-473b-9ba7-9f46f52eb040"}, {"server_uuid": "c62c36e6-6410-4f7d-9968-e0e7bded79fc", "name": "network-vif-plugged", "status": "completed", "tag": "e8ff5f7f-a025-473b-9ba7-9f46f52eb040"}, {"server_uuid": "c62c36e6-6410-4f7d-9968-e0e7bded79fc", "name": "network-vif-deleted", "tag": "e8ff5f7f-a025-473b-9ba7-9f46f52eb040"}, {"server_uuid": "c62c36e6-6410-4f7d-9968-e0e7bded79fc", "name": "network-vif-plugged", "status": "completed", "tag": "e8ff5f7f-a025-473b-9ba7-9f46f52eb040"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-a094a7d7-d9fa-464e-ab97-bb763f651c4d req-768ba3d2-8b3f-48da-bfd7-db519dc488f9 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-a094a7d7-d9fa-464e-ab97-bb763f651c4d req-768ba3d2-8b3f-48da-bfd7-db519dc488f9 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-a094a7d7-d9fa-464e-ab97-bb763f651c4d req-768ba3d2-8b3f-48da-bfd7-db519dc488f9 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-a094a7d7-d9fa-464e-ab97-bb763f651c4d req-768ba3d2-8b3f-48da-bfd7-db519dc488f9 service nova] Creating event network-vif-plugged:e8ff5f7f-a025-473b-9ba7-9f46f52eb040 for instance c62c36e6-6410-4f7d-9968-e0e7bded79fc on user Apr 20 15:13:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-a094a7d7-d9fa-464e-ab97-bb763f651c4d req-768ba3d2-8b3f-48da-bfd7-db519dc488f9 service nova] Creating event network-vif-plugged:e8ff5f7f-a025-473b-9ba7-9f46f52eb040 for instance c62c36e6-6410-4f7d-9968-e0e7bded79fc on user Apr 20 15:13:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-a094a7d7-d9fa-464e-ab97-bb763f651c4d req-768ba3d2-8b3f-48da-bfd7-db519dc488f9 service nova] Creating event network-vif-plugged:e8ff5f7f-a025-473b-9ba7-9f46f52eb040 for instance c62c36e6-6410-4f7d-9968-e0e7bded79fc on user Apr 20 15:13:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-a094a7d7-d9fa-464e-ab97-bb763f651c4d req-768ba3d2-8b3f-48da-bfd7-db519dc488f9 service nova] Creating event network-vif-deleted:e8ff5f7f-a025-473b-9ba7-9f46f52eb040 for instance c62c36e6-6410-4f7d-9968-e0e7bded79fc on user Apr 20 15:13:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-a094a7d7-d9fa-464e-ab97-bb763f651c4d req-768ba3d2-8b3f-48da-bfd7-db519dc488f9 service nova] Creating event network-vif-plugged:e8ff5f7f-a025-473b-9ba7-9f46f52eb040 for instance c62c36e6-6410-4f7d-9968-e0e7bded79fc on user Apr 20 15:13:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-a094a7d7-d9fa-464e-ab97-bb763f651c4d req-768ba3d2-8b3f-48da-bfd7-db519dc488f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.034938 Apr 20 15:13:10 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 69/202] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:10 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:16 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] [instance: 43cea1ab-3ddc-401d-97b3-3721808e2858] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:16 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] HTTP exception thrown: Instance 43cea1ab-3ddc-401d-97b3-3721808e2858 could not be found. Apr 20 15:13:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Request method failure captured: Apr 20 15:13:16 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858 HTTP/1.1 Apr 20 15:13:16 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:13:16 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:13:16 user devstack@n-api.service[61508]: Connection: close Apr 20 15:13:16 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:13:16 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:13:16 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:13:16 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:13:16 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVvKnb_swIK4p5TG-rChZzXgV2U1JXKdFMOs5HkSterZX4YgnfSUNBgofpcADzIdk8_xnOTnqlNxRhwHdRK-mUIFYzU8uc_YTaoWiAx6fBJgZOumpLlRFw88yOthBQAYR8DRydi7wAyhz52k_zMXiVc3tPhjFSKbVcsgn6Q2iSN33E Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Project-Id: 784602eedf114b789cbe062a0f4d8654 Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Project-Name: tempest-ServerStableDeviceRescueTest-340177059 Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/784602eedf114b789cbe062a0f4d8654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/784602eedf114b789cbe062a0f4d8654"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/784602eedf114b789cbe062a0f4d8654"}]}] Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Tenant: tempest-ServerStableDeviceRescueTest-340177059 Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Tenant-Id: 784602eedf114b789cbe062a0f4d8654 Apr 20 15:13:16 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-340177059 Apr 20 15:13:16 user devstack@n-api.service[61508]: X-User: tempest-ServerStableDeviceRescueTest-340177059-project-member Apr 20 15:13:16 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:13:16 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:13:16 user devstack@n-api.service[61508]: X-User-Id: 29e0c347919c4f92bca310629130038c Apr 20 15:13:16 user devstack@n-api.service[61508]: X-User-Name: tempest-ServerStableDeviceRescueTest-340177059-project-member Apr 20 15:13:16 user devstack@n-api.service[61508]: method: > Apr 20 15:13:16 user devstack@n-api.service[61508]: exception: Instance 43cea1ab-3ddc-401d-97b3-3721808e2858 could not be found. Apr 20 15:13:16 user devstack@n-api.service[61508]: action_args: {'id': '43cea1ab-3ddc-401d-97b3-3721808e2858'} Apr 20 15:13:16 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43cea1ab-3ddc-401d-97b3-3721808e2858 could not be found. Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43cea1ab-3ddc-401d-97b3-3721808e2858 could not be found. Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43cea1ab-3ddc-401d-97b3-3721808e2858 could not be found. Apr 20 15:13:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:13:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Returning 404 to user: Instance 43cea1ab-3ddc-401d-97b3-3721808e2858 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:13:16 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-60f1a937-338c-4f21-afb9-e55395707174 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858" status: 404 len: 111 microversion: 2.1 time: 0.029735 Apr 20 15:13:16 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 67/203] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:16 2023] GET /compute/v2.1/servers/43cea1ab-3ddc-401d-97b3-3721808e2858 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:13:16 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-630ca3c6-c576-4c7e-80ce-f52a2c08ee78 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] Calling method '.version_select at 0x7fcbb3752dd0>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:16 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-630ca3c6-c576-4c7e-80ce-f52a2c08ee78 tempest-ServerStableDeviceRescueTest-340177059 tempest-ServerStableDeviceRescueTest-340177059-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453607784" status: 202 len: 0 microversion: 2.1 time: 0.188575 Apr 20 15:13:16 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 68/204] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 15:13:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453607784 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: a41b61b3-ec9a-492b-b137-95e320dee7d1] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:17 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:17 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-6ea0f9a7-24cb-4fd7-9747-1a32290e7a96 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1" status: 200 len: 1691 microversion: 2.87 time: 0.521888 Apr 20 15:13:17 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 70/205] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:13:17 2023] GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1 => generated 1691 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 15:13:23 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-97f42698-b881-47d7-a241-de298322797e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:23 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-97f42698-b881-47d7-a241-de298322797e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-97f42698-b881-47d7-a241-de298322797e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-97f42698-b881-47d7-a241-de298322797e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-97f42698-b881-47d7-a241-de298322797e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-97f42698-b881-47d7-a241-de298322797e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-97f42698-b881-47d7-a241-de298322797e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-97f42698-b881-47d7-a241-de298322797e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:23 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-97f42698-b881-47d7-a241-de298322797e tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.296942 Apr 20 15:13:23 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 68/206] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 15:13:23 2023] GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f/os-interface => generated 282 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:24 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:24 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-a4aa1466-da52-4cdc-b4e9-9e7d3e0eb06b req-4d9dc5ff-ad4d-4a0f-81b9-ccf862aafa24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77755cf9-9e1b-4a77-a1e2-628876c5e06f", "tag": "30e678fc-1a8f-4b06-abee-54c719d1e99a"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-a4aa1466-da52-4cdc-b4e9-9e7d3e0eb06b req-4d9dc5ff-ad4d-4a0f-81b9-ccf862aafa24 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-a4aa1466-da52-4cdc-b4e9-9e7d3e0eb06b req-4d9dc5ff-ad4d-4a0f-81b9-ccf862aafa24 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-a4aa1466-da52-4cdc-b4e9-9e7d3e0eb06b req-4d9dc5ff-ad4d-4a0f-81b9-ccf862aafa24 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:24 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-a4aa1466-da52-4cdc-b4e9-9e7d3e0eb06b req-4d9dc5ff-ad4d-4a0f-81b9-ccf862aafa24 service nova] Creating event network-changed:30e678fc-1a8f-4b06-abee-54c719d1e99a for instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f on user Apr 20 15:13:24 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-a4aa1466-da52-4cdc-b4e9-9e7d3e0eb06b req-4d9dc5ff-ad4d-4a0f-81b9-ccf862aafa24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046668 Apr 20 15:13:24 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 69/207] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:24 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-35157e04-12b6-43c0-a5ba-ed9926562dde tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:24 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-35157e04-12b6-43c0-a5ba-ed9926562dde tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-35157e04-12b6-43c0-a5ba-ed9926562dde tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-35157e04-12b6-43c0-a5ba-ed9926562dde tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-35157e04-12b6-43c0-a5ba-ed9926562dde tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-35157e04-12b6-43c0-a5ba-ed9926562dde tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-35157e04-12b6-43c0-a5ba-ed9926562dde tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-35157e04-12b6-43c0-a5ba-ed9926562dde tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:24 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-35157e04-12b6-43c0-a5ba-ed9926562dde tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f/ips" status: 200 len: 108 microversion: 2.1 time: 0.037246 Apr 20 15:13:24 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 71/208] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 15:13:24 2023] GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f/ips => generated 108 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:25 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-c0e81514-a8e6-46fa-a595-8afbfa0f840d tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:25 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-c0e81514-a8e6-46fa-a595-8afbfa0f840d tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c0e81514-a8e6-46fa-a595-8afbfa0f840d tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c0e81514-a8e6-46fa-a595-8afbfa0f840d tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c0e81514-a8e6-46fa-a595-8afbfa0f840d tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c0e81514-a8e6-46fa-a595-8afbfa0f840d tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c0e81514-a8e6-46fa-a595-8afbfa0f840d tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c0e81514-a8e6-46fa-a595-8afbfa0f840d tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:26 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-c0e81514-a8e6-46fa-a595-8afbfa0f840d tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] Going to try to terminate instance {{(pid=61508) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:13:26 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-c0e81514-a8e6-46fa-a595-8afbfa0f840d tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f" status: 204 len: 0 microversion: 2.1 time: 0.129570 Apr 20 15:13:26 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 69/209] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:13:25 2023] DELETE /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:13:26 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-1be5fb62-bbd8-4283-860e-c627825c6586 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:26 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-1be5fb62-bbd8-4283-860e-c627825c6586 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1be5fb62-bbd8-4283-860e-c627825c6586 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1be5fb62-bbd8-4283-860e-c627825c6586 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1be5fb62-bbd8-4283-860e-c627825c6586 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1be5fb62-bbd8-4283-860e-c627825c6586 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1be5fb62-bbd8-4283-860e-c627825c6586 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1be5fb62-bbd8-4283-860e-c627825c6586 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:26 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-1be5fb62-bbd8-4283-860e-c627825c6586 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca4ca64cede4846a74e2cc4c13f3c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb81196155147cea0569f8a96465b6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:26 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-1be5fb62-bbd8-4283-860e-c627825c6586 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f" status: 200 len: 1670 microversion: 2.1 time: 0.238770 Apr 20 15:13:26 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 70/210] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:26 2023] GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f => generated 1670 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:13:26 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-f928e2bc-2e4e-4c6e-8286-c38c1d3c6343 req-52b30dfd-8ae2-451f-84fd-25e431149983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77755cf9-9e1b-4a77-a1e2-628876c5e06f", "name": "network-vif-unplugged", "status": "completed", "tag": "30e678fc-1a8f-4b06-abee-54c719d1e99a"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f928e2bc-2e4e-4c6e-8286-c38c1d3c6343 req-52b30dfd-8ae2-451f-84fd-25e431149983 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f928e2bc-2e4e-4c6e-8286-c38c1d3c6343 req-52b30dfd-8ae2-451f-84fd-25e431149983 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f928e2bc-2e4e-4c6e-8286-c38c1d3c6343 req-52b30dfd-8ae2-451f-84fd-25e431149983 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:26 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-f928e2bc-2e4e-4c6e-8286-c38c1d3c6343 req-52b30dfd-8ae2-451f-84fd-25e431149983 service nova] Creating event network-vif-unplugged:30e678fc-1a8f-4b06-abee-54c719d1e99a for instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f on user Apr 20 15:13:26 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-f928e2bc-2e4e-4c6e-8286-c38c1d3c6343 req-52b30dfd-8ae2-451f-84fd-25e431149983 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029720 Apr 20 15:13:26 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 72/211] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:27 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-a56a12a6-a4a5-4226-b419-c1b0b1ebb85c req-4d832df9-e3a5-4a86-ac6c-3b59bd1ba8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77755cf9-9e1b-4a77-a1e2-628876c5e06f", "name": "network-vif-deleted", "tag": "30e678fc-1a8f-4b06-abee-54c719d1e99a"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:27 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-a56a12a6-a4a5-4226-b419-c1b0b1ebb85c req-4d832df9-e3a5-4a86-ac6c-3b59bd1ba8fa service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:27 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-a56a12a6-a4a5-4226-b419-c1b0b1ebb85c req-4d832df9-e3a5-4a86-ac6c-3b59bd1ba8fa service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:27 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-a56a12a6-a4a5-4226-b419-c1b0b1ebb85c req-4d832df9-e3a5-4a86-ac6c-3b59bd1ba8fa service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:27 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-a56a12a6-a4a5-4226-b419-c1b0b1ebb85c req-4d832df9-e3a5-4a86-ac6c-3b59bd1ba8fa service nova] Creating event network-vif-deleted:30e678fc-1a8f-4b06-abee-54c719d1e99a for instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f on user Apr 20 15:13:27 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-a56a12a6-a4a5-4226-b419-c1b0b1ebb85c req-4d832df9-e3a5-4a86-ac6c-3b59bd1ba8fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 Apr 20 15:13:27 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 70/212] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 15:13:28 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-1dc68bc7-43b3-4ece-9187-a700becdea58 req-892a1d98-7dc3-494f-b50e-c20075c499dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77755cf9-9e1b-4a77-a1e2-628876c5e06f", "name": "network-vif-plugged", "status": "completed", "tag": "30e678fc-1a8f-4b06-abee-54c719d1e99a"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:28 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-1dc68bc7-43b3-4ece-9187-a700becdea58 req-892a1d98-7dc3-494f-b50e-c20075c499dd service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:28 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-1dc68bc7-43b3-4ece-9187-a700becdea58 req-892a1d98-7dc3-494f-b50e-c20075c499dd service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:28 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-1dc68bc7-43b3-4ece-9187-a700becdea58 req-892a1d98-7dc3-494f-b50e-c20075c499dd service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:28 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-1dc68bc7-43b3-4ece-9187-a700becdea58 req-892a1d98-7dc3-494f-b50e-c20075c499dd service nova] Creating event network-vif-plugged:30e678fc-1a8f-4b06-abee-54c719d1e99a for instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f on user Apr 20 15:13:28 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-1dc68bc7-43b3-4ece-9187-a700becdea58 req-892a1d98-7dc3-494f-b50e-c20075c499dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032196 Apr 20 15:13:28 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 71/213] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:28 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-7aa2910c-a008-4994-bc48-e00e057fa20c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Action: 'create', calling method: .version_select at 0x7fcbb37923b0>, body: {"keypair": {"name": "tempest-keypair-1717500440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGEIxUCHXXceUB/FApNxcL/7JaVCM5hcKMSc5CrjgYO5VislcRIMKIkmOsP8LLsfqr70V2EHv2ZJSrX+THOANHmmW7Ljmtrnvn+8G2QgLhFXKUIv52q7pauVXmcvV41sA=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:28 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-7aa2910c-a008-4994-bc48-e00e057fa20c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Getting quotas for project 3bfe062836ab4f98866f6058a0a50f66. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:13:28 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-7aa2910c-a008-4994-bc48-e00e057fa20c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Getting quotas for user bbd3a1bdaa3d4259a7f578e485a929ef and project 3bfe062836ab4f98866f6058a0a50f66. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:13:28 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-7aa2910c-a008-4994-bc48-e00e057fa20c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.100144 Apr 20 15:13:28 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 73/214] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 15:13:28 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 15:13:30 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-126892294", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "36cd0028-b711-4f91-837b-b0bef4168afd"}], "security_groups": [{"name": "tempest-securitygroup--286832701"}], "key_name": "tempest-keypair-1717500440", "user_data": "}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG nova.network.neutron [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] validate_networks() for [('36cd0028-b711-4f91-837b-b0bef4168afd', None, None, None, None, None)] {{(pid=61508) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Flavor limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Image limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Flavor pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Image pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Getting quotas for project 3bfe062836ab4f98866f6058a0a50f66. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Getting quotas for user bbd3a1bdaa3d4259a7f578e485a929ef and project 3bfe062836ab4f98866f6058a0a50f66. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Going to run 1 instances... {{(pid=61508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:13:31 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:13:31 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-5a6da240-57f0-4cc0-898a-fa50d5712e7e tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.811663 Apr 20 15:13:31 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 71/215] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 15:13:30 2023] POST /compute/v2.1/servers => generated 399 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 15:13:31 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-736145c6-3453-4f12-9c18-5d5751c217bd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:31 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-736145c6-3453-4f12-9c18-5d5751c217bd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:31 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-736145c6-3453-4f12-9c18-5d5751c217bd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:31 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-736145c6-3453-4f12-9c18-5d5751c217bd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:31 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-736145c6-3453-4f12-9c18-5d5751c217bd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:31 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-736145c6-3453-4f12-9c18-5d5751c217bd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a" status: 200 len: 1275 microversion: 2.20 time: 0.085113 Apr 20 15:13:31 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 72/216] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:13:31 2023] GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:13:32 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6ac94fba-7efd-46ad-a355-b5d15e59ba88 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:32 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-6ac94fba-7efd-46ad-a355-b5d15e59ba88 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ac94fba-7efd-46ad-a355-b5d15e59ba88 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ac94fba-7efd-46ad-a355-b5d15e59ba88 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ac94fba-7efd-46ad-a355-b5d15e59ba88 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ac94fba-7efd-46ad-a355-b5d15e59ba88 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ac94fba-7efd-46ad-a355-b5d15e59ba88 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6ac94fba-7efd-46ad-a355-b5d15e59ba88 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:32 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-6ac94fba-7efd-46ad-a355-b5d15e59ba88 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-6ac94fba-7efd-46ad-a355-b5d15e59ba88 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.265465 Apr 20 15:13:32 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 74/217] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:32 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:13:32 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-4e28ca2d-1bde-4e03-bbbe-f4224916c03a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:32 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-4e28ca2d-1bde-4e03-bbbe-f4224916c03a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4e28ca2d-1bde-4e03-bbbe-f4224916c03a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4e28ca2d-1bde-4e03-bbbe-f4224916c03a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4e28ca2d-1bde-4e03-bbbe-f4224916c03a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4e28ca2d-1bde-4e03-bbbe-f4224916c03a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4e28ca2d-1bde-4e03-bbbe-f4224916c03a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4e28ca2d-1bde-4e03-bbbe-f4224916c03a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:32 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-4e28ca2d-1bde-4e03-bbbe-f4224916c03a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:32 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-4e28ca2d-1bde-4e03-bbbe-f4224916c03a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.225226 Apr 20 15:13:32 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 72/218] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:32 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:13:32 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-3b5eb35c-beed-4b8c-b3b9-a3b25305e7b9 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:32 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-3b5eb35c-beed-4b8c-b3b9-a3b25305e7b9 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3b5eb35c-beed-4b8c-b3b9-a3b25305e7b9 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3b5eb35c-beed-4b8c-b3b9-a3b25305e7b9 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3b5eb35c-beed-4b8c-b3b9-a3b25305e7b9 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3b5eb35c-beed-4b8c-b3b9-a3b25305e7b9 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3b5eb35c-beed-4b8c-b3b9-a3b25305e7b9 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3b5eb35c-beed-4b8c-b3b9-a3b25305e7b9 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:32 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-3b5eb35c-beed-4b8c-b3b9-a3b25305e7b9 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:32 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-3b5eb35c-beed-4b8c-b3b9-a3b25305e7b9 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.150270 Apr 20 15:13:32 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 73/219] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:32 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:13:34 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-04d6c882-fb40-48a0-8c14-3bc144d11057 req-24a6b270-1776-46df-a731-bc89c67a65f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3055a84-dc65-4914-9d37-69d65383784a", "tag": "0871406a-12e1-412a-adcd-18302d02d26c"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-04d6c882-fb40-48a0-8c14-3bc144d11057 req-24a6b270-1776-46df-a731-bc89c67a65f2 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-04d6c882-fb40-48a0-8c14-3bc144d11057 req-24a6b270-1776-46df-a731-bc89c67a65f2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-04d6c882-fb40-48a0-8c14-3bc144d11057 req-24a6b270-1776-46df-a731-bc89c67a65f2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:34 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-04d6c882-fb40-48a0-8c14-3bc144d11057 req-24a6b270-1776-46df-a731-bc89c67a65f2 service nova] Creating event network-changed:0871406a-12e1-412a-adcd-18302d02d26c for instance e3055a84-dc65-4914-9d37-69d65383784a on user Apr 20 15:13:34 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-04d6c882-fb40-48a0-8c14-3bc144d11057 req-24a6b270-1776-46df-a731-bc89c67a65f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029257 Apr 20 15:13:34 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 75/220] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: f0ab3cf3-85dc-4f42-b81a-049ced9bac2c] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:35 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] HTTP exception thrown: Instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c could not be found. Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Request method failure captured: Apr 20 15:13:35 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c HTTP/1.1 Apr 20 15:13:35 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:13:35 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:13:35 user devstack@n-api.service[61508]: Connection: close Apr 20 15:13:35 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:13:35 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:13:35 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:13:35 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:13:35 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVsY8jl_q9YEJHGXfPuXMhC7mU9PBs7oKCi4JnihTXEAQm1db67GfA0aR3CaMpbIAuyrIW-R6DUJHqnL-zoOMLnQt2lACL99EIz5mZXmRTtISYhnFDDMSKAsAd1v2NUlfB73quarXD4BkucUWijX2RQMP6N-sxO22SO_ceyCA4vOeM Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Project-Id: baaed885af6443a2b5d13ece323b669a Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Project-Name: tempest-VolumesAdminNegativeTest-1501137224 Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/baaed885af6443a2b5d13ece323b669a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/baaed885af6443a2b5d13ece323b669a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/baaed885af6443a2b5d13ece323b669a"}]}] Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Tenant: tempest-VolumesAdminNegativeTest-1501137224 Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Tenant-Id: baaed885af6443a2b5d13ece323b669a Apr 20 15:13:35 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1501137224 Apr 20 15:13:35 user devstack@n-api.service[61508]: X-User: tempest-VolumesAdminNegativeTest-1501137224-project-member Apr 20 15:13:35 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:13:35 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:13:35 user devstack@n-api.service[61508]: X-User-Id: bd9585e756e6464da77a49905348b36a Apr 20 15:13:35 user devstack@n-api.service[61508]: X-User-Name: tempest-VolumesAdminNegativeTest-1501137224-project-member Apr 20 15:13:35 user devstack@n-api.service[61508]: method: > Apr 20 15:13:35 user devstack@n-api.service[61508]: exception: Instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c could not be found. Apr 20 15:13:35 user devstack@n-api.service[61508]: action_args: {'id': 'f0ab3cf3-85dc-4f42-b81a-049ced9bac2c'} Apr 20 15:13:35 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c could not be found. Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c could not be found. Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c could not be found. Apr 20 15:13:35 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Returning 404 to user: Instance f0ab3cf3-85dc-4f42-b81a-049ced9bac2c could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:13:35 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-801a71df-2212-4db6-97a5-ef31f3ca4042 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c" status: 404 len: 111 microversion: 2.1 time: 0.027860 Apr 20 15:13:35 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 73/221] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:35 2023] GET /compute/v2.1/servers/f0ab3cf3-85dc-4f42-b81a-049ced9bac2c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:13:35 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-a65c8ab9-da83-4f11-bd7c-7cb03d638646 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:35 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-a65c8ab9-da83-4f11-bd7c-7cb03d638646 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: aa981382-1b12-48d6-8661-0ddf1586a9af] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a65c8ab9-da83-4f11-bd7c-7cb03d638646 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a65c8ab9-da83-4f11-bd7c-7cb03d638646 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a65c8ab9-da83-4f11-bd7c-7cb03d638646 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a65c8ab9-da83-4f11-bd7c-7cb03d638646 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a65c8ab9-da83-4f11-bd7c-7cb03d638646 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a65c8ab9-da83-4f11-bd7c-7cb03d638646 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:35 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-a65c8ab9-da83-4f11-bd7c-7cb03d638646 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: aa981382-1b12-48d6-8661-0ddf1586a9af] Going to try to terminate instance {{(pid=61509) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:13:35 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-a65c8ab9-da83-4f11-bd7c-7cb03d638646 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af" status: 204 len: 0 microversion: 2.1 time: 0.149446 Apr 20 15:13:35 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 74/222] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:13:35 2023] DELETE /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:13:35 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-4bff35a4-e684-4c8a-a46e-726a79c93509 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:35 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-4bff35a4-e684-4c8a-a46e-726a79c93509 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: aa981382-1b12-48d6-8661-0ddf1586a9af] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4bff35a4-e684-4c8a-a46e-726a79c93509 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4bff35a4-e684-4c8a-a46e-726a79c93509 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4bff35a4-e684-4c8a-a46e-726a79c93509 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4bff35a4-e684-4c8a-a46e-726a79c93509 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4bff35a4-e684-4c8a-a46e-726a79c93509 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4bff35a4-e684-4c8a-a46e-726a79c93509 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-61345ebd-d4f3-42cc-8b93-ce7b70ddde19 req-d5d5a6f0-6e33-4330-b670-1a4368b89353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa981382-1b12-48d6-8661-0ddf1586a9af", "name": "network-vif-unplugged", "status": "completed", "tag": "af567b84-ebb0-479c-b788-240ef47450eb"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-61345ebd-d4f3-42cc-8b93-ce7b70ddde19 req-d5d5a6f0-6e33-4330-b670-1a4368b89353 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-61345ebd-d4f3-42cc-8b93-ce7b70ddde19 req-d5d5a6f0-6e33-4330-b670-1a4368b89353 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-61345ebd-d4f3-42cc-8b93-ce7b70ddde19 req-d5d5a6f0-6e33-4330-b670-1a4368b89353 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:35 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-4bff35a4-e684-4c8a-a46e-726a79c93509 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9585e756e6464da77a49905348b36a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaed885af6443a2b5d13ece323b669a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:35 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-61345ebd-d4f3-42cc-8b93-ce7b70ddde19 req-d5d5a6f0-6e33-4330-b670-1a4368b89353 service nova] Creating event network-vif-unplugged:af567b84-ebb0-479c-b788-240ef47450eb for instance aa981382-1b12-48d6-8661-0ddf1586a9af on user Apr 20 15:13:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-4bff35a4-e684-4c8a-a46e-726a79c93509 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af" status: 200 len: 1669 microversion: 2.1 time: 0.321730 Apr 20 15:13:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 76/223] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:35 2023] GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af => generated 1669 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:13:35 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-61345ebd-d4f3-42cc-8b93-ce7b70ddde19 req-d5d5a6f0-6e33-4330-b670-1a4368b89353 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029156 Apr 20 15:13:35 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 74/224] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:36 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-40c16043-615a-4fb2-92ac-7bc7dc6238e9 req-deb6dc23-a765-462a-97af-26a58b7d2e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3055a84-dc65-4914-9d37-69d65383784a", "name": "network-vif-plugged", "status": "completed", "tag": "0871406a-12e1-412a-adcd-18302d02d26c"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:36 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-40c16043-615a-4fb2-92ac-7bc7dc6238e9 req-deb6dc23-a765-462a-97af-26a58b7d2e10 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:36 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-40c16043-615a-4fb2-92ac-7bc7dc6238e9 req-deb6dc23-a765-462a-97af-26a58b7d2e10 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:36 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-40c16043-615a-4fb2-92ac-7bc7dc6238e9 req-deb6dc23-a765-462a-97af-26a58b7d2e10 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:36 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-40c16043-615a-4fb2-92ac-7bc7dc6238e9 req-deb6dc23-a765-462a-97af-26a58b7d2e10 service nova] Creating event network-vif-plugged:0871406a-12e1-412a-adcd-18302d02d26c for instance e3055a84-dc65-4914-9d37-69d65383784a on user Apr 20 15:13:36 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-40c16043-615a-4fb2-92ac-7bc7dc6238e9 req-deb6dc23-a765-462a-97af-26a58b7d2e10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033388 Apr 20 15:13:36 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 75/225] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-d1d72c2f-d6bb-47d1-b668-077610308a05 req-bc2cdd2b-803e-496f-a713-e606012456f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa981382-1b12-48d6-8661-0ddf1586a9af", "name": "network-vif-deleted", "tag": "af567b84-ebb0-479c-b788-240ef47450eb"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d1d72c2f-d6bb-47d1-b668-077610308a05 req-bc2cdd2b-803e-496f-a713-e606012456f1 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d1d72c2f-d6bb-47d1-b668-077610308a05 req-bc2cdd2b-803e-496f-a713-e606012456f1 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d1d72c2f-d6bb-47d1-b668-077610308a05 req-bc2cdd2b-803e-496f-a713-e606012456f1 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-d1d72c2f-d6bb-47d1-b668-077610308a05 req-bc2cdd2b-803e-496f-a713-e606012456f1 service nova] Creating event network-vif-deleted:af567b84-ebb0-479c-b788-240ef47450eb for instance aa981382-1b12-48d6-8661-0ddf1586a9af on user Apr 20 15:13:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-d1d72c2f-d6bb-47d1-b668-077610308a05 req-bc2cdd2b-803e-496f-a713-e606012456f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030481 Apr 20 15:13:37 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 77/226] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:37 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-166de2bd-e6c9-4989-998d-a085f7e04026 req-3a45989f-8772-45ea-b7cb-5a0b765b2fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa981382-1b12-48d6-8661-0ddf1586a9af", "name": "network-vif-plugged", "status": "completed", "tag": "af567b84-ebb0-479c-b788-240ef47450eb"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-166de2bd-e6c9-4989-998d-a085f7e04026 req-3a45989f-8772-45ea-b7cb-5a0b765b2fa8 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-166de2bd-e6c9-4989-998d-a085f7e04026 req-3a45989f-8772-45ea-b7cb-5a0b765b2fa8 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-166de2bd-e6c9-4989-998d-a085f7e04026 req-3a45989f-8772-45ea-b7cb-5a0b765b2fa8 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-166de2bd-e6c9-4989-998d-a085f7e04026 req-3a45989f-8772-45ea-b7cb-5a0b765b2fa8 service nova] Creating event network-vif-plugged:af567b84-ebb0-479c-b788-240ef47450eb for instance aa981382-1b12-48d6-8661-0ddf1586a9af on user Apr 20 15:13:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-166de2bd-e6c9-4989-998d-a085f7e04026 req-3a45989f-8772-45ea-b7cb-5a0b765b2fa8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027051 Apr 20 15:13:37 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 75/227] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:38 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-718d504c-52d0-4198-97a1-f2d3a7dcd63f req-7d5c00c6-c0af-46c0-9b0b-95459ced08d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3055a84-dc65-4914-9d37-69d65383784a", "name": "network-vif-plugged", "status": "completed", "tag": "0871406a-12e1-412a-adcd-18302d02d26c"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:38 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-718d504c-52d0-4198-97a1-f2d3a7dcd63f req-7d5c00c6-c0af-46c0-9b0b-95459ced08d6 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-718d504c-52d0-4198-97a1-f2d3a7dcd63f req-7d5c00c6-c0af-46c0-9b0b-95459ced08d6 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:39 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-718d504c-52d0-4198-97a1-f2d3a7dcd63f req-7d5c00c6-c0af-46c0-9b0b-95459ced08d6 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:39 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-718d504c-52d0-4198-97a1-f2d3a7dcd63f req-7d5c00c6-c0af-46c0-9b0b-95459ced08d6 service nova] Creating event network-vif-plugged:0871406a-12e1-412a-adcd-18302d02d26c for instance e3055a84-dc65-4914-9d37-69d65383784a on user Apr 20 15:13:39 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-718d504c-52d0-4198-97a1-f2d3a7dcd63f req-7d5c00c6-c0af-46c0-9b0b-95459ced08d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037161 Apr 20 15:13:39 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 76/228] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-eedac19c-de6a-49b7-98f5-ca8ea48ac2e0 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-eedac19c-de6a-49b7-98f5-ca8ea48ac2e0 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] [instance: 12403233-648f-4d8b-aeaf-039340a8cbae] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-eedac19c-de6a-49b7-98f5-ca8ea48ac2e0 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-eedac19c-de6a-49b7-98f5-ca8ea48ac2e0 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-eedac19c-de6a-49b7-98f5-ca8ea48ac2e0 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-eedac19c-de6a-49b7-98f5-ca8ea48ac2e0 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-eedac19c-de6a-49b7-98f5-ca8ea48ac2e0 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-eedac19c-de6a-49b7-98f5-ca8ea48ac2e0 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:48 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-eedac19c-de6a-49b7-98f5-ca8ea48ac2e0 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] [instance: 12403233-648f-4d8b-aeaf-039340a8cbae] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:13:49 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-eedac19c-de6a-49b7-98f5-ca8ea48ac2e0 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae" status: 204 len: 0 microversion: 2.1 time: 0.118284 Apr 20 15:13:49 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 78/229] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:13:48 2023] DELETE /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-43f84666-5189-4263-9b09-05e93c568c0b tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-43f84666-5189-4263-9b09-05e93c568c0b tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] [instance: 12403233-648f-4d8b-aeaf-039340a8cbae] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-43f84666-5189-4263-9b09-05e93c568c0b tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-43f84666-5189-4263-9b09-05e93c568c0b tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-43f84666-5189-4263-9b09-05e93c568c0b tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-43f84666-5189-4263-9b09-05e93c568c0b tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-43f84666-5189-4263-9b09-05e93c568c0b tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-43f84666-5189-4263-9b09-05e93c568c0b tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:49 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-43f84666-5189-4263-9b09-05e93c568c0b tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69e3cd8e2b4e89916785ae929558c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7452508975f646dc9998777965d2c9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:49 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-43f84666-5189-4263-9b09-05e93c568c0b tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae" status: 200 len: 1492 microversion: 2.1 time: 0.298576 Apr 20 15:13:49 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 76/230] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:49 2023] GET /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae => generated 1492 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:13:49 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:49 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:49 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=1 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:13:49 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-5244d94c-ca40-4620-8af9-175852c1b0fc req-c6841435-2fb2-42a7-a377-8a0a6b15d0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12403233-648f-4d8b-aeaf-039340a8cbae", "name": "network-vif-unplugged", "status": "completed", "tag": "71a59558-2e91-4d33-802c-55d86e1efb44"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:49 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-5244d94c-ca40-4620-8af9-175852c1b0fc req-c6841435-2fb2-42a7-a377-8a0a6b15d0c4 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:49 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-5244d94c-ca40-4620-8af9-175852c1b0fc req-c6841435-2fb2-42a7-a377-8a0a6b15d0c4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:49 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-5244d94c-ca40-4620-8af9-175852c1b0fc req-c6841435-2fb2-42a7-a377-8a0a6b15d0c4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:49 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-5244d94c-ca40-4620-8af9-175852c1b0fc req-c6841435-2fb2-42a7-a377-8a0a6b15d0c4 service nova] Creating event network-vif-unplugged:71a59558-2e91-4d33-802c-55d86e1efb44 for instance 12403233-648f-4d8b-aeaf-039340a8cbae on user Apr 20 15:13:49 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-5244d94c-ca40-4620-8af9-175852c1b0fc req-c6841435-2fb2-42a7-a377-8a0a6b15d0c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095422 Apr 20 15:13:49 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 77/231] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:50 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-be6f9035-9581-471e-99ff-98365a7b1bb2 req-d8da0236-9e4e-4e05-a606-ca93cb3d1431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12403233-648f-4d8b-aeaf-039340a8cbae", "name": "network-vif-deleted", "tag": "71a59558-2e91-4d33-802c-55d86e1efb44"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-be6f9035-9581-471e-99ff-98365a7b1bb2 req-d8da0236-9e4e-4e05-a606-ca93cb3d1431 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-be6f9035-9581-471e-99ff-98365a7b1bb2 req-d8da0236-9e4e-4e05-a606-ca93cb3d1431 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-be6f9035-9581-471e-99ff-98365a7b1bb2 req-d8da0236-9e4e-4e05-a606-ca93cb3d1431 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:50 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-be6f9035-9581-471e-99ff-98365a7b1bb2 req-d8da0236-9e4e-4e05-a606-ca93cb3d1431 service nova] Creating event network-vif-deleted:71a59558-2e91-4d33-802c-55d86e1efb44 for instance 12403233-648f-4d8b-aeaf-039340a8cbae on user Apr 20 15:13:50 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-be6f9035-9581-471e-99ff-98365a7b1bb2 req-d8da0236-9e4e-4e05-a606-ca93cb3d1431 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091398 Apr 20 15:13:50 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 79/232] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:51 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-bf8ff4e6-5d29-4f3e-9c5d-f5dba31407e7 req-2839d5ac-48ea-461d-99a2-59d53a654088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12403233-648f-4d8b-aeaf-039340a8cbae", "name": "network-vif-plugged", "status": "completed", "tag": "71a59558-2e91-4d33-802c-55d86e1efb44"}, {"server_uuid": "12403233-648f-4d8b-aeaf-039340a8cbae", "name": "network-vif-plugged", "status": "completed", "tag": "71a59558-2e91-4d33-802c-55d86e1efb44"}, {"server_uuid": "12403233-648f-4d8b-aeaf-039340a8cbae", "name": "network-vif-plugged", "status": "completed", "tag": "71a59558-2e91-4d33-802c-55d86e1efb44"}, {"server_uuid": "12403233-648f-4d8b-aeaf-039340a8cbae", "name": "network-vif-plugged", "status": "completed", "tag": "71a59558-2e91-4d33-802c-55d86e1efb44"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:13:51 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-bf8ff4e6-5d29-4f3e-9c5d-f5dba31407e7 req-2839d5ac-48ea-461d-99a2-59d53a654088 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:51 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-bf8ff4e6-5d29-4f3e-9c5d-f5dba31407e7 req-2839d5ac-48ea-461d-99a2-59d53a654088 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:51 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-bf8ff4e6-5d29-4f3e-9c5d-f5dba31407e7 req-2839d5ac-48ea-461d-99a2-59d53a654088 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:51 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-bf8ff4e6-5d29-4f3e-9c5d-f5dba31407e7 req-2839d5ac-48ea-461d-99a2-59d53a654088 service nova] Creating event network-vif-plugged:71a59558-2e91-4d33-802c-55d86e1efb44 for instance 12403233-648f-4d8b-aeaf-039340a8cbae on user Apr 20 15:13:51 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-bf8ff4e6-5d29-4f3e-9c5d-f5dba31407e7 req-2839d5ac-48ea-461d-99a2-59d53a654088 service nova] Creating event network-vif-plugged:71a59558-2e91-4d33-802c-55d86e1efb44 for instance 12403233-648f-4d8b-aeaf-039340a8cbae on user Apr 20 15:13:51 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-bf8ff4e6-5d29-4f3e-9c5d-f5dba31407e7 req-2839d5ac-48ea-461d-99a2-59d53a654088 service nova] Creating event network-vif-plugged:71a59558-2e91-4d33-802c-55d86e1efb44 for instance 12403233-648f-4d8b-aeaf-039340a8cbae on user Apr 20 15:13:51 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-bf8ff4e6-5d29-4f3e-9c5d-f5dba31407e7 req-2839d5ac-48ea-461d-99a2-59d53a654088 service nova] Creating event network-vif-plugged:71a59558-2e91-4d33-802c-55d86e1efb44 for instance 12403233-648f-4d8b-aeaf-039340a8cbae on user Apr 20 15:13:51 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-bf8ff4e6-5d29-4f3e-9c5d-f5dba31407e7 req-2839d5ac-48ea-461d-99a2-59d53a654088 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.031589 Apr 20 15:13:51 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 77/233] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:13:51 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:13:58 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:58 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: c62c36e6-6410-4f7d-9968-e0e7bded79fc] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:58 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] HTTP exception thrown: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:13:58 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Request method failure captured: Apr 20 15:13:58 user devstack@n-api.service[61509]: request: GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc HTTP/1.1 Apr 20 15:13:58 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:13:58 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:13:58 user devstack@n-api.service[61509]: Connection: close Apr 20 15:13:58 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:13:58 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:13:58 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:13:58 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:13:58 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVWkyBXvY6UZjnCugjjyakm7BAN9il6WMWd6FzgczquyuN_v0937tzd-RY3meTHvgtCizgGF1Lo1bYjYhgO3j3liR5TRa4-o-jSRjQhPKIte1OmbW-QQ1Igl6agKdh82fRexT_-0RTtOiTim7SCWe59Q3nbG2CPPrbIYtT74ucT9wEE Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Project-Id: 061d2444339049d0a0bb680f55ce75e3 Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Project-Name: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/061d2444339049d0a0bb680f55ce75e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/061d2444339049d0a0bb680f55ce75e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/061d2444339049d0a0bb680f55ce75e3"}]}] Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Tenant: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Tenant-Id: 061d2444339049d0a0bb680f55ce75e3 Apr 20 15:13:58 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:13:58 user devstack@n-api.service[61509]: X-User: tempest-ServersNegativeTestJSON-1460486547-project-member Apr 20 15:13:58 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:13:58 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:13:58 user devstack@n-api.service[61509]: X-User-Id: 515a83630b834f03a4fd748fb75b3550 Apr 20 15:13:58 user devstack@n-api.service[61509]: X-User-Name: tempest-ServersNegativeTestJSON-1460486547-project-member Apr 20 15:13:58 user devstack@n-api.service[61509]: method: > Apr 20 15:13:58 user devstack@n-api.service[61509]: exception: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:13:58 user devstack@n-api.service[61509]: action_args: {'id': 'c62c36e6-6410-4f7d-9968-e0e7bded79fc'} Apr 20 15:13:58 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:13:58 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:13:58 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Returning 404 to user: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:13:58 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-65f5937f-1d19-4a42-a1a8-68ec743f4ffe tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc" status: 404 len: 111 microversion: 2.1 time: 0.030019 Apr 20 15:13:58 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 78/234] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:58 2023] GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:13:58 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c0820be2-1f1b-4da3-8fa5-1053b7ec984d tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:13:58 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c0820be2-1f1b-4da3-8fa5-1053b7ec984d tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:13:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c0820be2-1f1b-4da3-8fa5-1053b7ec984d tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c0820be2-1f1b-4da3-8fa5-1053b7ec984d tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c0820be2-1f1b-4da3-8fa5-1053b7ec984d tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c0820be2-1f1b-4da3-8fa5-1053b7ec984d tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:13:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c0820be2-1f1b-4da3-8fa5-1053b7ec984d tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:13:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c0820be2-1f1b-4da3-8fa5-1053b7ec984d tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:13:58 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-c0820be2-1f1b-4da3-8fa5-1053b7ec984d tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515a83630b834f03a4fd748fb75b3550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d2444339049d0a0bb680f55ce75e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:13:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c0820be2-1f1b-4da3-8fa5-1053b7ec984d tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82" status: 200 len: 1494 microversion: 2.1 time: 0.223434 Apr 20 15:13:58 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 80/235] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:13:58 2023] GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 => generated 1494 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=8 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:16 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] HTTP exception thrown: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Request method failure captured: Apr 20 15:14:16 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f HTTP/1.1 Apr 20 15:14:16 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:14:16 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:14:16 user devstack@n-api.service[61508]: Connection: close Apr 20 15:14:16 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:14:16 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:14:16 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:14:16 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:14:16 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVx-U3QuV56Gy0TyipJvTPOcFQQTpehiuNsftdc0T5QMNXwtHTigVlX6LYAeTyjlobrUG05VFTlPrv0JZi9TUXTchee5Zjkc8RQE1BVwMrQG1dhl_fNaPnphr8mz74teZGGMRCnAaE9JAkOBDCXRc0vrPyW0Iq_TLcRQUBNHMdGhkE Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Project-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Project-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bb81196155147cea0569f8a96465b6a"}]}] Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Tenant: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Tenant-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:14:16 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:14:16 user devstack@n-api.service[61508]: X-User: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:14:16 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:14:16 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:14:16 user devstack@n-api.service[61508]: X-User-Id: 8ca4ca64cede4846a74e2cc4c13f3c14 Apr 20 15:14:16 user devstack@n-api.service[61508]: X-User-Name: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:14:16 user devstack@n-api.service[61508]: method: > Apr 20 15:14:16 user devstack@n-api.service[61508]: exception: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:14:16 user devstack@n-api.service[61508]: action_args: {'id': '77755cf9-9e1b-4a77-a1e2-628876c5e06f'} Apr 20 15:14:16 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:14:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:14:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Returning 404 to user: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:14:16 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-95d831b9-ee15-4204-8936-97fca18ec47f tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f" status: 404 len: 111 microversion: 2.1 time: 0.147939 Apr 20 15:14:16 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 78/236] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:14:16 2023] GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:14:16 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-293d8a0e-62f6-430c-ac9f-67b4d721a508 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '.version_select at 0x7fcbb3753370>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:16 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=4 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:16 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=4 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:16 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-293d8a0e-62f6-430c-ac9f-67b4d721a508 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1083332030" status: 202 len: 0 microversion: 2.1 time: 0.031192 Apr 20 15:14:16 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 79/237] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 15:14:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1083332030 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:14:17 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c2335c5e-788d-41f2-8295-b91dd0453c48 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Action: 'create', calling method: .version_select at 0x7fcbb36053f0>, body: {"keypair": {"name": "tempest-keypair-221995507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBt3d9iD9PEoMRVWFDD5lqhgaYzgaIlyqASftwiGGoa7ZPXy3UY4piQhUOYcJ6QOkp7DP2Ar+DOJgqox5X6fnn4wqOEC+K0A6cprqv1Cij3kn3hnXHGewJu7AsAiKeRgQ=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:17 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:17 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:17 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-c2335c5e-788d-41f2-8295-b91dd0453c48 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for project 5bb81196155147cea0569f8a96465b6a. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:14:17 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-c2335c5e-788d-41f2-8295-b91dd0453c48 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for user 8ca4ca64cede4846a74e2cc4c13f3c14 and project 5bb81196155147cea0569f8a96465b6a. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:14:17 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c2335c5e-788d-41f2-8295-b91dd0453c48 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055827 Apr 20 15:14:17 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 81/238] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:14:17 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:14:17 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-35d8ffd3-7c7b-434f-971f-7d1a51bd7012 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1993490773"}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:17 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-35d8ffd3-7c7b-434f-971f-7d1a51bd7012 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: a41b61b3-ec9a-492b-b137-95e320dee7d1] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:14:17 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-35d8ffd3-7c7b-434f-971f-7d1a51bd7012 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:17 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-35d8ffd3-7c7b-434f-971f-7d1a51bd7012 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:17 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-35d8ffd3-7c7b-434f-971f-7d1a51bd7012 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:17 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-35d8ffd3-7c7b-434f-971f-7d1a51bd7012 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:17 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-35d8ffd3-7c7b-434f-971f-7d1a51bd7012 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:17 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-35d8ffd3-7c7b-434f-971f-7d1a51bd7012 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:18 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-35d8ffd3-7c7b-434f-971f-7d1a51bd7012 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1/action" status: 202 len: 52 microversion: 2.87 time: 0.840905 Apr 20 15:14:18 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 79/239] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 15:14:17 2023] POST /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1/action => generated 52 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 15:14:18 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-632405412", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "edb31b42-2f23-479e-8912-fbfd502dae97"}], "security_groups": [{"name": "tempest-securitygroup--509445034"}], "key_name": "tempest-keypair-221995507", "user_data": "}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG nova.network.neutron [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] validate_networks() for [('edb31b42-2f23-479e-8912-fbfd502dae97', None, None, None, None, None)] {{(pid=61509) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Flavor limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Image limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Flavor pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Image pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for project 5bb81196155147cea0569f8a96465b6a. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Getting quotas for user 8ca4ca64cede4846a74e2cc4c13f3c14 and project 5bb81196155147cea0569f8a96465b6a. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Going to run 1 instances... {{(pid=61509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:14:19 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:14:19 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-f947ba18-a57a-4612-a141-b8d1d8c866ae tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.870445 Apr 20 15:14:19 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 80/240] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:14:18 2023] POST /compute/v2.1/servers => generated 399 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:14:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-d57fd386-1efb-4094-ad02-a5d3e8c7e65b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:19 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-d57fd386-1efb-4094-ad02-a5d3e8c7e65b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:14:19 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-d57fd386-1efb-4094-ad02-a5d3e8c7e65b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca4ca64cede4846a74e2cc4c13f3c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb81196155147cea0569f8a96465b6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:14:19 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-d57fd386-1efb-4094-ad02-a5d3e8c7e65b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26" status: 200 len: 1234 microversion: 2.1 time: 0.068508 Apr 20 15:14:19 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 82/241] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:14:19 2023] GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 => generated 1234 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:14:21 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:21 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:14:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:22 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:14:22 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:14:22 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:14:22 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-d212596c-4b41-4db1-8b82-3373b9cc1e68 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a" status: 200 len: 1586 microversion: 2.20 time: 0.244371 Apr 20 15:14:22 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 80/242] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:14:21 2023] GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a => generated 1586 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:14:22 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-ceba73a0-9536-480d-ac85-ccce1911e756 req-095f607e-9ea4-4a88-8a85-efa63b4aa558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26", "tag": "22fdbf0e-d74b-4bfd-b575-a9df2ec357f6"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:22 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-ceba73a0-9536-480d-ac85-ccce1911e756 req-095f607e-9ea4-4a88-8a85-efa63b4aa558 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:22 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-ceba73a0-9536-480d-ac85-ccce1911e756 req-095f607e-9ea4-4a88-8a85-efa63b4aa558 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:22 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-ceba73a0-9536-480d-ac85-ccce1911e756 req-095f607e-9ea4-4a88-8a85-efa63b4aa558 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:22 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-ceba73a0-9536-480d-ac85-ccce1911e756 req-095f607e-9ea4-4a88-8a85-efa63b4aa558 service nova] Creating event network-changed:22fdbf0e-d74b-4bfd-b575-a9df2ec357f6 for instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 on user Apr 20 15:14:22 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-ceba73a0-9536-480d-ac85-ccce1911e756 req-095f607e-9ea4-4a88-8a85-efa63b4aa558 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035693 Apr 20 15:14:22 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 81/243] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:14:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: a41b61b3-ec9a-492b-b137-95e320dee7d1] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:14:23 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:14:24 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-68398b57-321a-43ce-94f6-edc0d04a40fa tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1" status: 200 len: 1691 microversion: 2.87 time: 0.234361 Apr 20 15:14:24 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 83/244] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:14:23 2023] GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1 => generated 1691 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:14:24 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-2bd569c8-2bdb-4ce0-a584-e2976d59ad47 req-a125c90d-fad8-4b83-a011-b105411583c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26", "name": "network-vif-plugged", "status": "completed", "tag": "22fdbf0e-d74b-4bfd-b575-a9df2ec357f6"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:24 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-2bd569c8-2bdb-4ce0-a584-e2976d59ad47 req-a125c90d-fad8-4b83-a011-b105411583c8 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:24 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-2bd569c8-2bdb-4ce0-a584-e2976d59ad47 req-a125c90d-fad8-4b83-a011-b105411583c8 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:24 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-2bd569c8-2bdb-4ce0-a584-e2976d59ad47 req-a125c90d-fad8-4b83-a011-b105411583c8 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:24 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-2bd569c8-2bdb-4ce0-a584-e2976d59ad47 req-a125c90d-fad8-4b83-a011-b105411583c8 service nova] Creating event network-vif-plugged:22fdbf0e-d74b-4bfd-b575-a9df2ec357f6 for instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 on user Apr 20 15:14:24 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-2bd569c8-2bdb-4ce0-a584-e2976d59ad47 req-a125c90d-fad8-4b83-a011-b105411583c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029145 Apr 20 15:14:24 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 81/245] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:14:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:14:25 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:25 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] [instance: aa981382-1b12-48d6-8661-0ddf1586a9af] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:14:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:26 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:26 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] HTTP exception thrown: Instance aa981382-1b12-48d6-8661-0ddf1586a9af could not be found. Apr 20 15:14:26 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Request method failure captured: Apr 20 15:14:26 user devstack@n-api.service[61509]: request: GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af HTTP/1.1 Apr 20 15:14:26 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:14:26 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:14:26 user devstack@n-api.service[61509]: Connection: close Apr 20 15:14:26 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:14:26 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:14:26 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:14:26 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:14:26 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVVsY8jl_q9YEJHGXfPuXMhC7mU9PBs7oKCi4JnihTXEAQm1db67GfA0aR3CaMpbIAuyrIW-R6DUJHqnL-zoOMLnQt2lACL99EIz5mZXmRTtISYhnFDDMSKAsAd1v2NUlfB73quarXD4BkucUWijX2RQMP6N-sxO22SO_ceyCA4vOeM Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Project-Id: baaed885af6443a2b5d13ece323b669a Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Project-Name: tempest-VolumesAdminNegativeTest-1501137224 Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/baaed885af6443a2b5d13ece323b669a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/baaed885af6443a2b5d13ece323b669a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/baaed885af6443a2b5d13ece323b669a"}]}] Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Tenant: tempest-VolumesAdminNegativeTest-1501137224 Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Tenant-Id: baaed885af6443a2b5d13ece323b669a Apr 20 15:14:26 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1501137224 Apr 20 15:14:26 user devstack@n-api.service[61509]: X-User: tempest-VolumesAdminNegativeTest-1501137224-project-member Apr 20 15:14:26 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:14:26 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:14:26 user devstack@n-api.service[61509]: X-User-Id: bd9585e756e6464da77a49905348b36a Apr 20 15:14:26 user devstack@n-api.service[61509]: X-User-Name: tempest-VolumesAdminNegativeTest-1501137224-project-member Apr 20 15:14:26 user devstack@n-api.service[61509]: method: > Apr 20 15:14:26 user devstack@n-api.service[61509]: exception: Instance aa981382-1b12-48d6-8661-0ddf1586a9af could not be found. Apr 20 15:14:26 user devstack@n-api.service[61509]: action_args: {'id': 'aa981382-1b12-48d6-8661-0ddf1586a9af'} Apr 20 15:14:26 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa981382-1b12-48d6-8661-0ddf1586a9af could not be found. Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa981382-1b12-48d6-8661-0ddf1586a9af could not be found. Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa981382-1b12-48d6-8661-0ddf1586a9af could not be found. Apr 20 15:14:26 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:14:26 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Returning 404 to user: Instance aa981382-1b12-48d6-8661-0ddf1586a9af could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:14:26 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-040e134b-d424-40f3-ae32-38781de594ee tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af" status: 404 len: 111 microversion: 2.1 time: 0.141562 Apr 20 15:14:26 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 82/246] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:14:25 2023] GET /compute/v2.1/servers/aa981382-1b12-48d6-8661-0ddf1586a9af => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:14:26 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-7d4a07cd-e00e-4a2a-b2ab-e8ab22228176 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] Calling method '.version_select at 0x7fcbb3607c70>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:26 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-7d4a07cd-e00e-4a2a-b2ab-e8ab22228176 tempest-VolumesAdminNegativeTest-1501137224 tempest-VolumesAdminNegativeTest-1501137224-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824375720" status: 202 len: 0 microversion: 2.1 time: 0.042106 Apr 20 15:14:26 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 84/247] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 15:14:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824375720 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:14:26 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-10dd8ea8-b0bc-4fb6-885f-54bff21b0e60 req-c17208bb-a19b-4550-a19b-ffad3088efa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26", "name": "network-vif-plugged", "status": "completed", "tag": "22fdbf0e-d74b-4bfd-b575-a9df2ec357f6"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-10dd8ea8-b0bc-4fb6-885f-54bff21b0e60 req-c17208bb-a19b-4550-a19b-ffad3088efa2 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-10dd8ea8-b0bc-4fb6-885f-54bff21b0e60 req-c17208bb-a19b-4550-a19b-ffad3088efa2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:26 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-10dd8ea8-b0bc-4fb6-885f-54bff21b0e60 req-c17208bb-a19b-4550-a19b-ffad3088efa2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:26 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-10dd8ea8-b0bc-4fb6-885f-54bff21b0e60 req-c17208bb-a19b-4550-a19b-ffad3088efa2 service nova] Creating event network-vif-plugged:22fdbf0e-d74b-4bfd-b575-a9df2ec357f6 for instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 on user Apr 20 15:14:26 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-10dd8ea8-b0bc-4fb6-885f-54bff21b0e60 req-c17208bb-a19b-4550-a19b-ffad3088efa2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030783 Apr 20 15:14:26 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 82/248] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-afbf127d-0131-4442-8faf-fdade964c533 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-afbf127d-0131-4442-8faf-fdade964c533 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-afbf127d-0131-4442-8faf-fdade964c533 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-afbf127d-0131-4442-8faf-fdade964c533 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-afbf127d-0131-4442-8faf-fdade964c533 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-afbf127d-0131-4442-8faf-fdade964c533 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-afbf127d-0131-4442-8faf-fdade964c533 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-afbf127d-0131-4442-8faf-fdade964c533 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:34 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-afbf127d-0131-4442-8faf-fdade964c533 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:14:34 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-afbf127d-0131-4442-8faf-fdade964c533 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.255915 Apr 20 15:14:34 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 83/249] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:14:34 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] [instance: 12403233-648f-4d8b-aeaf-039340a8cbae] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] HTTP exception thrown: Instance 12403233-648f-4d8b-aeaf-039340a8cbae could not be found. Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Request method failure captured: Apr 20 15:14:39 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae HTTP/1.1 Apr 20 15:14:39 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:14:39 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:14:39 user devstack@n-api.service[61510]: Connection: close Apr 20 15:14:39 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:14:39 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:14:39 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:14:39 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:14:39 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVY67ewyslwy64nBKs_sngA86X3nIw8hqY1l444BWnOeiYAzYtTNJ1mKm5-2_FLrhmGF6oirwtN7ucRgzO9bdUS5okCbz4o6zeDqcrfF6FRlDePIxtpqQV_duOKrqq8JjnnLDeQVU_A8tt5BK8l-qWL7v9_WYnGbHYaU5MPgj_wSRrc Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Project-Id: 7452508975f646dc9998777965d2c9dc Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Project-Name: tempest-VolumesActionsTest-137441792 Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7452508975f646dc9998777965d2c9dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7452508975f646dc9998777965d2c9dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7452508975f646dc9998777965d2c9dc"}]}] Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Tenant: tempest-VolumesActionsTest-137441792 Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Tenant-Id: 7452508975f646dc9998777965d2c9dc Apr 20 15:14:39 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-VolumesActionsTest-137441792 Apr 20 15:14:39 user devstack@n-api.service[61510]: X-User: tempest-VolumesActionsTest-137441792-project-member Apr 20 15:14:39 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:14:39 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:14:39 user devstack@n-api.service[61510]: X-User-Id: cd69e3cd8e2b4e89916785ae929558c8 Apr 20 15:14:39 user devstack@n-api.service[61510]: X-User-Name: tempest-VolumesActionsTest-137441792-project-member Apr 20 15:14:39 user devstack@n-api.service[61510]: method: > Apr 20 15:14:39 user devstack@n-api.service[61510]: exception: Instance 12403233-648f-4d8b-aeaf-039340a8cbae could not be found. Apr 20 15:14:39 user devstack@n-api.service[61510]: action_args: {'id': '12403233-648f-4d8b-aeaf-039340a8cbae'} Apr 20 15:14:39 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12403233-648f-4d8b-aeaf-039340a8cbae could not be found. Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12403233-648f-4d8b-aeaf-039340a8cbae could not be found. Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12403233-648f-4d8b-aeaf-039340a8cbae could not be found. Apr 20 15:14:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:14:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] Returning 404 to user: Instance 12403233-648f-4d8b-aeaf-039340a8cbae could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:14:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-08d60f53-423b-49c0-af1f-bc68d7a01360 tempest-VolumesActionsTest-137441792 tempest-VolumesActionsTest-137441792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae" status: 404 len: 111 microversion: 2.1 time: 0.037631 Apr 20 15:14:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 85/250] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:14:39 2023] GET /compute/v2.1/servers/12403233-648f-4d8b-aeaf-039340a8cbae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=10 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-967782803", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.network.neutron [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] validate_networks() for [('5baaa9a4-8348-4cde-a1d3-5858762b19cb', None, None, None, None, None)] {{(pid=61508) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Flavor limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Image limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Flavor pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Image pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Getting quotas for project 277c8babb24c43c6b386883035b7476c. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Getting quotas for user cd02e13ff5394016b693bfb61c0dd244 and project 277c8babb24c43c6b386883035b7476c. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Going to run 1 instances... {{(pid=61508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:14:41 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 32f44a87-50b3-449f-83dc-a7102cf727c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:14:41 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-f0059aef-0fa3-4248-a935-f0d20d975acf tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.740538 Apr 20 15:14:41 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 83/251] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:14:41 2023] POST /compute/v2.1/servers => generated 381 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:14:41 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-b017a361-13ae-4ad6-8bb0-1b16628790ef tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:41 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-b017a361-13ae-4ad6-8bb0-1b16628790ef tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 32f44a87-50b3-449f-83dc-a7102cf727c5] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:14:42 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-b017a361-13ae-4ad6-8bb0-1b16628790ef tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02e13ff5394016b693bfb61c0dd244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277c8babb24c43c6b386883035b7476c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:14:42 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-b017a361-13ae-4ad6-8bb0-1b16628790ef tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5" status: 200 len: 1215 microversion: 2.1 time: 0.066603 Apr 20 15:14:42 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 84/252] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:14:41 2023] GET /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-184107739", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] validate_networks() for [('5baaa9a4-8348-4cde-a1d3-5858762b19cb', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Getting quotas for project 277c8babb24c43c6b386883035b7476c. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Getting quotas for user cd02e13ff5394016b693bfb61c0dd244 and project 277c8babb24c43c6b386883035b7476c. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:14:42 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 66242fcd-cd65-442b-8643-b33fe81a8061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:14:42 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-a7fa2704-39ce-48da-a39d-b6c9e364236d tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.650418 Apr 20 15:14:42 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 86/253] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:14:42 2023] POST /compute/v2.1/servers => generated 381 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:14:42 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-348db57f-65d0-4625-b97b-08fd4c61e6a5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:14:42 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-348db57f-65d0-4625-b97b-08fd4c61e6a5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 66242fcd-cd65-442b-8643-b33fe81a8061] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:14:42 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-348db57f-65d0-4625-b97b-08fd4c61e6a5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02e13ff5394016b693bfb61c0dd244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277c8babb24c43c6b386883035b7476c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:14:42 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-348db57f-65d0-4625-b97b-08fd4c61e6a5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061" status: 200 len: 1215 microversion: 2.1 time: 0.061521 Apr 20 15:14:42 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 84/254] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:14:42 2023] GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061 => generated 1215 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:14:44 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-c62e0898-744a-4b66-b5ff-a5d8815623fa req-54139dd8-5a17-4b63-8a2e-6a02ad22fae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f44a87-50b3-449f-83dc-a7102cf727c5", "tag": "e41b3010-3209-45da-85ac-c0ae82f1938c"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-c62e0898-744a-4b66-b5ff-a5d8815623fa req-54139dd8-5a17-4b63-8a2e-6a02ad22fae3 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-c62e0898-744a-4b66-b5ff-a5d8815623fa req-54139dd8-5a17-4b63-8a2e-6a02ad22fae3 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-c62e0898-744a-4b66-b5ff-a5d8815623fa req-54139dd8-5a17-4b63-8a2e-6a02ad22fae3 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:44 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-c62e0898-744a-4b66-b5ff-a5d8815623fa req-54139dd8-5a17-4b63-8a2e-6a02ad22fae3 service nova] Creating event network-changed:e41b3010-3209-45da-85ac-c0ae82f1938c for instance 32f44a87-50b3-449f-83dc-a7102cf727c5 on user Apr 20 15:14:44 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-c62e0898-744a-4b66-b5ff-a5d8815623fa req-54139dd8-5a17-4b63-8a2e-6a02ad22fae3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067921 Apr 20 15:14:44 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 85/255] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:14:45 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-c67e6476-bcee-492a-8e0a-ac1e9ca91458 req-151ac901-6eb3-4ca0-8256-5baa426d0ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66242fcd-cd65-442b-8643-b33fe81a8061", "tag": "fa3c5cc7-be23-4a32-823e-086e69742eda"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-c67e6476-bcee-492a-8e0a-ac1e9ca91458 req-151ac901-6eb3-4ca0-8256-5baa426d0ff4 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-c67e6476-bcee-492a-8e0a-ac1e9ca91458 req-151ac901-6eb3-4ca0-8256-5baa426d0ff4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-c67e6476-bcee-492a-8e0a-ac1e9ca91458 req-151ac901-6eb3-4ca0-8256-5baa426d0ff4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-c67e6476-bcee-492a-8e0a-ac1e9ca91458 req-151ac901-6eb3-4ca0-8256-5baa426d0ff4 service nova] Creating event network-changed:fa3c5cc7-be23-4a32-823e-086e69742eda for instance 66242fcd-cd65-442b-8643-b33fe81a8061 on user Apr 20 15:14:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-c67e6476-bcee-492a-8e0a-ac1e9ca91458 req-151ac901-6eb3-4ca0-8256-5baa426d0ff4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043463 Apr 20 15:14:45 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 87/256] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:14:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:14:46 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-c4b0438d-8f87-4988-b04c-fd94502ae20c req-9582949d-ab19-461a-9831-bb2bf767a035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f44a87-50b3-449f-83dc-a7102cf727c5", "name": "network-vif-plugged", "status": "completed", "tag": "e41b3010-3209-45da-85ac-c0ae82f1938c"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:46 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-c4b0438d-8f87-4988-b04c-fd94502ae20c req-9582949d-ab19-461a-9831-bb2bf767a035 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:46 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-c4b0438d-8f87-4988-b04c-fd94502ae20c req-9582949d-ab19-461a-9831-bb2bf767a035 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:46 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-c4b0438d-8f87-4988-b04c-fd94502ae20c req-9582949d-ab19-461a-9831-bb2bf767a035 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:46 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-c4b0438d-8f87-4988-b04c-fd94502ae20c req-9582949d-ab19-461a-9831-bb2bf767a035 service nova] Creating event network-vif-plugged:e41b3010-3209-45da-85ac-c0ae82f1938c for instance 32f44a87-50b3-449f-83dc-a7102cf727c5 on user Apr 20 15:14:46 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-c4b0438d-8f87-4988-b04c-fd94502ae20c req-9582949d-ab19-461a-9831-bb2bf767a035 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028918 Apr 20 15:14:46 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 85/257] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:14:48 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-e748a5e1-4ac6-4b0c-94d9-be5aa0249778 req-04ee53a5-b95f-4f56-8399-26fbbc219201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66242fcd-cd65-442b-8643-b33fe81a8061", "name": "network-vif-plugged", "status": "completed", "tag": "fa3c5cc7-be23-4a32-823e-086e69742eda"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:48 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:48 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e748a5e1-4ac6-4b0c-94d9-be5aa0249778 req-04ee53a5-b95f-4f56-8399-26fbbc219201 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:48 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e748a5e1-4ac6-4b0c-94d9-be5aa0249778 req-04ee53a5-b95f-4f56-8399-26fbbc219201 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:48 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e748a5e1-4ac6-4b0c-94d9-be5aa0249778 req-04ee53a5-b95f-4f56-8399-26fbbc219201 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:48 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=15 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:14:48 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-e748a5e1-4ac6-4b0c-94d9-be5aa0249778 req-04ee53a5-b95f-4f56-8399-26fbbc219201 service nova] Creating event network-vif-plugged:fa3c5cc7-be23-4a32-823e-086e69742eda for instance 66242fcd-cd65-442b-8643-b33fe81a8061 on user Apr 20 15:14:48 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-e748a5e1-4ac6-4b0c-94d9-be5aa0249778 req-04ee53a5-b95f-4f56-8399-26fbbc219201 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044604 Apr 20 15:14:48 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 86/258] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:14:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:14:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-2050dcdb-c52d-46f2-aafa-054b9992108c req-4a28659d-ae38-4626-abdd-6c8b5b805c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f44a87-50b3-449f-83dc-a7102cf727c5", "name": "network-vif-plugged", "status": "completed", "tag": "e41b3010-3209-45da-85ac-c0ae82f1938c"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2050dcdb-c52d-46f2-aafa-054b9992108c req-4a28659d-ae38-4626-abdd-6c8b5b805c21 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2050dcdb-c52d-46f2-aafa-054b9992108c req-4a28659d-ae38-4626-abdd-6c8b5b805c21 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2050dcdb-c52d-46f2-aafa-054b9992108c req-4a28659d-ae38-4626-abdd-6c8b5b805c21 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:48 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-2050dcdb-c52d-46f2-aafa-054b9992108c req-4a28659d-ae38-4626-abdd-6c8b5b805c21 service nova] Creating event network-vif-plugged:e41b3010-3209-45da-85ac-c0ae82f1938c for instance 32f44a87-50b3-449f-83dc-a7102cf727c5 on user Apr 20 15:14:48 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-2050dcdb-c52d-46f2-aafa-054b9992108c req-4a28659d-ae38-4626-abdd-6c8b5b805c21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032406 Apr 20 15:14:48 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 88/259] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:14:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 15:14:50 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-506b4514-5146-48f7-843c-057efdd64dc5 req-6a86c5d1-1404-43a8-88b4-dca10a730d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66242fcd-cd65-442b-8643-b33fe81a8061", "name": "network-vif-plugged", "status": "completed", "tag": "fa3c5cc7-be23-4a32-823e-086e69742eda"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:14:50 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-506b4514-5146-48f7-843c-057efdd64dc5 req-6a86c5d1-1404-43a8-88b4-dca10a730d74 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:14:50 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-506b4514-5146-48f7-843c-057efdd64dc5 req-6a86c5d1-1404-43a8-88b4-dca10a730d74 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:14:50 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-506b4514-5146-48f7-843c-057efdd64dc5 req-6a86c5d1-1404-43a8-88b4-dca10a730d74 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:14:50 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-506b4514-5146-48f7-843c-057efdd64dc5 req-6a86c5d1-1404-43a8-88b4-dca10a730d74 service nova] Creating event network-vif-plugged:fa3c5cc7-be23-4a32-823e-086e69742eda for instance 66242fcd-cd65-442b-8643-b33fe81a8061 on user Apr 20 15:14:50 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-506b4514-5146-48f7-843c-057efdd64dc5 req-6a86c5d1-1404-43a8-88b4-dca10a730d74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043896 Apr 20 15:14:50 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 86/260] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:14:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:15:00 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:00 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=1 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:00 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-1cdf9ac3-07a1-421d-9464-a939874e6ae7 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:00 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-1cdf9ac3-07a1-421d-9464-a939874e6ae7 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1cdf9ac3-07a1-421d-9464-a939874e6ae7 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1cdf9ac3-07a1-421d-9464-a939874e6ae7 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1cdf9ac3-07a1-421d-9464-a939874e6ae7 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1cdf9ac3-07a1-421d-9464-a939874e6ae7 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1cdf9ac3-07a1-421d-9464-a939874e6ae7 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1cdf9ac3-07a1-421d-9464-a939874e6ae7 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:01 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-1cdf9ac3-07a1-421d-9464-a939874e6ae7 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515a83630b834f03a4fd748fb75b3550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d2444339049d0a0bb680f55ce75e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:01 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-1cdf9ac3-07a1-421d-9464-a939874e6ae7 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82" status: 200 len: 1494 microversion: 2.1 time: 0.761791 Apr 20 15:15:01 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 87/261] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:15:00 2023] GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 => generated 1494 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:15:08 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:08 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:08 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:08 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=8 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:08 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-47edc39a-287e-49c3-8787-683aecc6237a tempest-TestStampPattern-2016754894 tempest-TestStampPattern-2016754894-project-member] Action: 'create', calling method: .version_select at 0x7fcbb3737d00>, body: {"keypair": {"name": "tempest-TestStampPattern-24580646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2w6URrVvdFGkTkpsj9PqpeNxBiPBFWiHkZ0dTLp0Uvs5HCqqjpor42LfbYdTFICQWaTQBy4NCzLQVtsY9oi9H8R2p8brnXBCtzosNeaITiBdmzJY9drgrcmmaCQGiQ4A=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:09 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-47edc39a-287e-49c3-8787-683aecc6237a tempest-TestStampPattern-2016754894 tempest-TestStampPattern-2016754894-project-member] Getting quotas for project 59d4e37a0fea4291a576f06da7e1cd47. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:15:09 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-47edc39a-287e-49c3-8787-683aecc6237a tempest-TestStampPattern-2016754894 tempest-TestStampPattern-2016754894-project-member] Getting quotas for user f82702b0cbb74deb8c2730f05880cb8d and project 59d4e37a0fea4291a576f06da7e1cd47. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:15:09 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-47edc39a-287e-49c3-8787-683aecc6237a tempest-TestStampPattern-2016754894 tempest-TestStampPattern-2016754894-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 393 microversion: 2.1 time: 0.326044 Apr 20 15:15:09 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 89/262] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:15:08 2023] POST /compute/v2.1/os-keypairs => generated 393 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=8 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-ebcdb373-3a9b-47c0-91c8-a6b0ef160c0a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-ebcdb373-3a9b-47c0-91c8-a6b0ef160c0a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ebcdb373-3a9b-47c0-91c8-a6b0ef160c0a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ebcdb373-3a9b-47c0-91c8-a6b0ef160c0a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ebcdb373-3a9b-47c0-91c8-a6b0ef160c0a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ebcdb373-3a9b-47c0-91c8-a6b0ef160c0a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ebcdb373-3a9b-47c0-91c8-a6b0ef160c0a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ebcdb373-3a9b-47c0-91c8-a6b0ef160c0a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:10 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-ebcdb373-3a9b-47c0-91c8-a6b0ef160c0a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca4ca64cede4846a74e2cc4c13f3c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb81196155147cea0569f8a96465b6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:10 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-ebcdb373-3a9b-47c0-91c8-a6b0ef160c0a tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26" status: 200 len: 1543 microversion: 2.1 time: 0.358128 Apr 20 15:15:10 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 87/263] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:15:09 2023] GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 => generated 1543 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:15:12 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:12 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-8f4a5f98-f41d-4424-97ce-27b58c8c53a2 tempest-TestStampPattern-2016754894 tempest-TestStampPattern-2016754894-project-member] Calling method '.version_select at 0x7fcbb3753c70>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:12 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-8f4a5f98-f41d-4424-97ce-27b58c8c53a2 tempest-TestStampPattern-2016754894 tempest-TestStampPattern-2016754894-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-24580646" status: 202 len: 0 microversion: 2.1 time: 0.029465 Apr 20 15:15:12 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 88/264] 10.0.0.210 () {62 vars in 1319 bytes} [Thu Apr 20 15:15:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-24580646 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:15:22 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:22 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:22 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-34b39730-2623-4257-bbeb-63508ca0ffc6 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:22 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-34b39730-2623-4257-bbeb-63508ca0ffc6 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-34b39730-2623-4257-bbeb-63508ca0ffc6 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-34b39730-2623-4257-bbeb-63508ca0ffc6 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-34b39730-2623-4257-bbeb-63508ca0ffc6 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-34b39730-2623-4257-bbeb-63508ca0ffc6 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-34b39730-2623-4257-bbeb-63508ca0ffc6 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-34b39730-2623-4257-bbeb-63508ca0ffc6 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:22 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-34b39730-2623-4257-bbeb-63508ca0ffc6 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.175561 Apr 20 15:15:22 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 90/265] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 15:15:22 2023] GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a/os-interface => generated 282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:15:23 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:23 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:23 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-dbf49215-361a-4960-85a6-517d410de87b req-9a88c891-47ca-464c-9a9d-22e9ef1ff2fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3055a84-dc65-4914-9d37-69d65383784a", "tag": "0871406a-12e1-412a-adcd-18302d02d26c"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-dbf49215-361a-4960-85a6-517d410de87b req-9a88c891-47ca-464c-9a9d-22e9ef1ff2fd service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-dbf49215-361a-4960-85a6-517d410de87b req-9a88c891-47ca-464c-9a9d-22e9ef1ff2fd service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:23 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-dbf49215-361a-4960-85a6-517d410de87b req-9a88c891-47ca-464c-9a9d-22e9ef1ff2fd service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:23 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-dbf49215-361a-4960-85a6-517d410de87b req-9a88c891-47ca-464c-9a9d-22e9ef1ff2fd service nova] Creating event network-changed:0871406a-12e1-412a-adcd-18302d02d26c for instance e3055a84-dc65-4914-9d37-69d65383784a on user Apr 20 15:15:23 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-dbf49215-361a-4960-85a6-517d410de87b req-9a88c891-47ca-464c-9a9d-22e9ef1ff2fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038784 Apr 20 15:15:23 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 88/266] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:15:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:15:23 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:23 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-1fc69add-6b78-4158-a391-1535204b1039 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:23 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-1fc69add-6b78-4158-a391-1535204b1039 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:23 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1fc69add-6b78-4158-a391-1535204b1039 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:23 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1fc69add-6b78-4158-a391-1535204b1039 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:23 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1fc69add-6b78-4158-a391-1535204b1039 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:23 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1fc69add-6b78-4158-a391-1535204b1039 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:23 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1fc69add-6b78-4158-a391-1535204b1039 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:23 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1fc69add-6b78-4158-a391-1535204b1039 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:23 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-1fc69add-6b78-4158-a391-1535204b1039 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a/ips" status: 200 len: 110 microversion: 2.20 time: 0.048091 Apr 20 15:15:23 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 89/267] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 15:15:23 2023] GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a/ips => generated 110 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1675429109", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "destination_type": "volume"}], "networks": [{"uuid": "3626f883-4d6a-49ba-95ea-b76718169d69"}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] validate_networks() for [('3626f883-4d6a-49ba-95ea-b76718169d69', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-39b97388-37ed-4981-a657-7c0c6fc30152 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-39b97388-37ed-4981-a657-7c0c6fc30152 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-39b97388-37ed-4981-a657-7c0c6fc30152 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-39b97388-37ed-4981-a657-7c0c6fc30152 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-39b97388-37ed-4981-a657-7c0c6fc30152 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-39b97388-37ed-4981-a657-7c0c6fc30152 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-39b97388-37ed-4981-a657-7c0c6fc30152 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-39b97388-37ed-4981-a657-7c0c6fc30152 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-39b97388-37ed-4981-a657-7c0c6fc30152 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] Going to try to terminate instance {{(pid=61508) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Getting quotas for project b53c73dfc9094d05802c05b2f25d6bed. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Getting quotas for user f19d8fcc1b69479992ff0d8bc5c99306 and project b53c73dfc9094d05802c05b2f25d6bed. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:15:24 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:15:24 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-39b97388-37ed-4981-a657-7c0c6fc30152 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a" status: 204 len: 0 microversion: 2.20 time: 0.123598 Apr 20 15:15:24 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 89/268] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 15:15:24 2023] DELETE /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 15:15:24 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-3564e622-3061-4520-a8cf-2d8c5c896f45 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.624499 Apr 20 15:15:24 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 91/269] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 15:15:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 15:15:24 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:24 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-0038288e-702a-44d4-b113-aa3c1270abb6 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:24 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-0038288e-702a-44d4-b113-aa3c1270abb6 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:25 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-0038288e-702a-44d4-b113-aa3c1270abb6 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:25 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-0038288e-702a-44d4-b113-aa3c1270abb6 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:25 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-0038288e-702a-44d4-b113-aa3c1270abb6 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:25 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-0038288e-702a-44d4-b113-aa3c1270abb6 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e60ade-dd93-42f6-accf-d3d051fee951" status: 200 len: 1395 microversion: 2.87 time: 0.181654 Apr 20 15:15:25 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 90/270] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:15:24 2023] GET /compute/v2.1/servers/10e60ade-dd93-42f6-accf-d3d051fee951 => generated 1395 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:15:25 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-f8d0ceec-7cab-4082-a67f-c15b1ab3f4be req-5b913fea-a5f4-455f-929f-3aa9bea64c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3055a84-dc65-4914-9d37-69d65383784a", "name": "network-vif-unplugged", "status": "completed", "tag": "0871406a-12e1-412a-adcd-18302d02d26c"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f8d0ceec-7cab-4082-a67f-c15b1ab3f4be req-5b913fea-a5f4-455f-929f-3aa9bea64c2c service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f8d0ceec-7cab-4082-a67f-c15b1ab3f4be req-5b913fea-a5f4-455f-929f-3aa9bea64c2c service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f8d0ceec-7cab-4082-a67f-c15b1ab3f4be req-5b913fea-a5f4-455f-929f-3aa9bea64c2c service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-f8d0ceec-7cab-4082-a67f-c15b1ab3f4be req-5b913fea-a5f4-455f-929f-3aa9bea64c2c service nova] Creating event network-vif-unplugged:0871406a-12e1-412a-adcd-18302d02d26c for instance e3055a84-dc65-4914-9d37-69d65383784a on user Apr 20 15:15:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-f8d0ceec-7cab-4082-a67f-c15b1ab3f4be req-5b913fea-a5f4-455f-929f-3aa9bea64c2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034353 Apr 20 15:15:25 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 92/271] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:15:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 15:15:25 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:25 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:25 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:25 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-491ce8e2-f8e8-42fb-9e39-d647f7e26df9 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a" status: 200 len: 1711 microversion: 2.20 time: 0.549565 Apr 20 15:15:25 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 90/272] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:15:24 2023] GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a => generated 1711 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:15:27 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-09051835-d6f5-406f-9a44-436f748ad92b req-3320c76a-d0e9-4926-bcc8-5752630bd8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3055a84-dc65-4914-9d37-69d65383784a", "name": "network-vif-plugged", "status": "completed", "tag": "0871406a-12e1-412a-adcd-18302d02d26c"}, {"server_uuid": "e3055a84-dc65-4914-9d37-69d65383784a", "name": "network-vif-deleted", "tag": "0871406a-12e1-412a-adcd-18302d02d26c"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:27 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-09051835-d6f5-406f-9a44-436f748ad92b req-3320c76a-d0e9-4926-bcc8-5752630bd8b7 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:27 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-09051835-d6f5-406f-9a44-436f748ad92b req-3320c76a-d0e9-4926-bcc8-5752630bd8b7 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:27 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-09051835-d6f5-406f-9a44-436f748ad92b req-3320c76a-d0e9-4926-bcc8-5752630bd8b7 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:27 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-09051835-d6f5-406f-9a44-436f748ad92b req-3320c76a-d0e9-4926-bcc8-5752630bd8b7 service nova] Creating event network-vif-plugged:0871406a-12e1-412a-adcd-18302d02d26c for instance e3055a84-dc65-4914-9d37-69d65383784a on user Apr 20 15:15:27 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-09051835-d6f5-406f-9a44-436f748ad92b req-3320c76a-d0e9-4926-bcc8-5752630bd8b7 service nova] Creating event network-vif-deleted:0871406a-12e1-412a-adcd-18302d02d26c for instance e3055a84-dc65-4914-9d37-69d65383784a on user Apr 20 15:15:27 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-09051835-d6f5-406f-9a44-436f748ad92b req-3320c76a-d0e9-4926-bcc8-5752630bd8b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031780 Apr 20 15:15:27 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 91/273] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:15:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:15:27 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-52a3c632-faea-42e8-a6da-98b9f56931bd req-85d384ef-60ad-4746-acb7-568abe50754a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e60ade-dd93-42f6-accf-d3d051fee951", "tag": "cba74407-94f0-4700-9320-6aa66bdb76c8"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-52a3c632-faea-42e8-a6da-98b9f56931bd req-85d384ef-60ad-4746-acb7-568abe50754a service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-52a3c632-faea-42e8-a6da-98b9f56931bd req-85d384ef-60ad-4746-acb7-568abe50754a service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-52a3c632-faea-42e8-a6da-98b9f56931bd req-85d384ef-60ad-4746-acb7-568abe50754a service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:27 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-52a3c632-faea-42e8-a6da-98b9f56931bd req-85d384ef-60ad-4746-acb7-568abe50754a service nova] Creating event network-changed:cba74407-94f0-4700-9320-6aa66bdb76c8 for instance 10e60ade-dd93-42f6-accf-d3d051fee951 on user Apr 20 15:15:28 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-52a3c632-faea-42e8-a6da-98b9f56931bd req-85d384ef-60ad-4746-acb7-568abe50754a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029988 Apr 20 15:15:28 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 93/274] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:15:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:15:29 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-e50024ea-972f-4fbc-8af7-ae148f8f7302 req-5bda8a5a-3ab1-4953-8821-9150232c6eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e60ade-dd93-42f6-accf-d3d051fee951", "name": "network-vif-deleted", "tag": "cba74407-94f0-4700-9320-6aa66bdb76c8"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e50024ea-972f-4fbc-8af7-ae148f8f7302 req-5bda8a5a-3ab1-4953-8821-9150232c6eef service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e50024ea-972f-4fbc-8af7-ae148f8f7302 req-5bda8a5a-3ab1-4953-8821-9150232c6eef service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:29 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e50024ea-972f-4fbc-8af7-ae148f8f7302 req-5bda8a5a-3ab1-4953-8821-9150232c6eef service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:29 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.compute.server_external_events [req-e50024ea-972f-4fbc-8af7-ae148f8f7302 req-5bda8a5a-3ab1-4953-8821-9150232c6eef service nova] Unable to find a host for instance 10e60ade-dd93-42f6-accf-d3d051fee951. Dropping event network-vif-deleted {{(pid=61509) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 15:15:29 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-e50024ea-972f-4fbc-8af7-ae148f8f7302 req-5bda8a5a-3ab1-4953-8821-9150232c6eef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032117 Apr 20 15:15:29 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 91/275] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:15:29 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 15:15:32 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-63cf55d8-be7e-464b-b4c0-7d50605e93f3 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:32 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-63cf55d8-be7e-464b-b4c0-7d50605e93f3 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 66242fcd-cd65-442b-8643-b33fe81a8061] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63cf55d8-be7e-464b-b4c0-7d50605e93f3 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63cf55d8-be7e-464b-b4c0-7d50605e93f3 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63cf55d8-be7e-464b-b4c0-7d50605e93f3 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63cf55d8-be7e-464b-b4c0-7d50605e93f3 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63cf55d8-be7e-464b-b4c0-7d50605e93f3 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63cf55d8-be7e-464b-b4c0-7d50605e93f3 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:33 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-63cf55d8-be7e-464b-b4c0-7d50605e93f3 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02e13ff5394016b693bfb61c0dd244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277c8babb24c43c6b386883035b7476c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:33 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-63cf55d8-be7e-464b-b4c0-7d50605e93f3 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061" status: 200 len: 1503 microversion: 2.1 time: 0.409411 Apr 20 15:15:33 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 92/276] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:15:32 2023] GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061 => generated 1503 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ab2f1cf4-e123-4862-8ca8-aa1c797a0779 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ab2f1cf4-e123-4862-8ca8-aa1c797a0779 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab2f1cf4-e123-4862-8ca8-aa1c797a0779 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab2f1cf4-e123-4862-8ca8-aa1c797a0779 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab2f1cf4-e123-4862-8ca8-aa1c797a0779 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab2f1cf4-e123-4862-8ca8-aa1c797a0779 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab2f1cf4-e123-4862-8ca8-aa1c797a0779 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab2f1cf4-e123-4862-8ca8-aa1c797a0779 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:35 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-ab2f1cf4-e123-4862-8ca8-aa1c797a0779 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-ab2f1cf4-e123-4862-8ca8-aa1c797a0779 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.233587 Apr 20 15:15:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 94/277] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:15:35 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:15:35 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-5b09ae37-d132-43e9-a534-ced3859475a1 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:35 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-5b09ae37-d132-43e9-a534-ced3859475a1 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5b09ae37-d132-43e9-a534-ced3859475a1 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5b09ae37-d132-43e9-a534-ced3859475a1 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5b09ae37-d132-43e9-a534-ced3859475a1 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5b09ae37-d132-43e9-a534-ced3859475a1 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5b09ae37-d132-43e9-a534-ced3859475a1 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-5b09ae37-d132-43e9-a534-ced3859475a1 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:35 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-5b09ae37-d132-43e9-a534-ced3859475a1 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:35 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-5b09ae37-d132-43e9-a534-ced3859475a1 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.585866 Apr 20 15:15:35 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 92/278] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:15:35 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:15:35 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-d28f70ff-c174-43cf-b147-5a30cb314cd5 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:35 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-d28f70ff-c174-43cf-b147-5a30cb314cd5 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:35 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d28f70ff-c174-43cf-b147-5a30cb314cd5 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d28f70ff-c174-43cf-b147-5a30cb314cd5 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d28f70ff-c174-43cf-b147-5a30cb314cd5 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d28f70ff-c174-43cf-b147-5a30cb314cd5 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d28f70ff-c174-43cf-b147-5a30cb314cd5 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:35 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-d28f70ff-c174-43cf-b147-5a30cb314cd5 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:36 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-d28f70ff-c174-43cf-b147-5a30cb314cd5 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:36 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-d28f70ff-c174-43cf-b147-5a30cb314cd5 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.146841 Apr 20 15:15:36 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 93/279] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:15:35 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:15:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-0a76d7fe-1d81-4d34-a89b-1ad55054e053 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Action: 'create', calling method: .version_select at 0x7fcbb3607400>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1842611209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGzvHh8Zr7UHBOWp8i4itmOgKMHCYqsRfcCnuL5fX2ZX0SbtdnEHhZQ7ddVen4EblOd/75MqiVTCjXy8yMqdL2bAyWSSoNF8aBLCqnNMnema/pWEDoxhzJlvUqg4HZ4hA=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:40 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-0a76d7fe-1d81-4d34-a89b-1ad55054e053 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Getting quotas for project 5b3b0b5be268475b92a96fcc1b02094e. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:15:40 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-0a76d7fe-1d81-4d34-a89b-1ad55054e053 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Getting quotas for user 1b2b076c0e354876981854fbadcc4696 and project 5b3b0b5be268475b92a96fcc1b02094e. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:15:40 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-0a76d7fe-1d81-4d34-a89b-1ad55054e053 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.251716 Apr 20 15:15:40 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 95/280] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:15:40 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:15:41 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-72297812", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1842611209", "security_groups": [{"name": "tempest-secgroup-smoke-1518407054"}], "networks": [{"uuid": "edf7eb54-231b-4696-a66a-a86d72c64dc2"}]}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:41 user devstack@n-api.service[61509]: DEBUG nova.network.neutron [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] validate_networks() for [('edf7eb54-231b-4696-a66a-a86d72c64dc2', None, None, None, None, None)] {{(pid=61509) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Flavor limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Image limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Flavor pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Image pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Getting quotas for project 5b3b0b5be268475b92a96fcc1b02094e. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Getting quotas for user 1b2b076c0e354876981854fbadcc4696 and project 5b3b0b5be268475b92a96fcc1b02094e. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Going to run 1 instances... {{(pid=61509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:15:42 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] [instance: 71994663-7386-42fc-b512-59869acddfc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:15:42 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-8f134d61-1d7d-4598-a76f-e0abe0ee9eec tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.616102 Apr 20 15:15:42 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 93/281] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:15:41 2023] POST /compute/v2.1/servers => generated 404 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:15:42 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-eb48f101-c190-40f2-a8ad-2199bc329f87 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:15:42 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-eb48f101-c190-40f2-a8ad-2199bc329f87 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] [instance: 71994663-7386-42fc-b512-59869acddfc0] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:15:42 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-eb48f101-c190-40f2-a8ad-2199bc329f87 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2b076c0e354876981854fbadcc4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3b0b5be268475b92a96fcc1b02094e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:15:42 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-eb48f101-c190-40f2-a8ad-2199bc329f87 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0" status: 200 len: 1255 microversion: 2.1 time: 0.064200 Apr 20 15:15:42 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 94/282] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:15:42 2023] GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0 => generated 1255 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:15:45 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=16 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:45 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-1dd2b4d7-7630-4f24-b16f-3391221319cc req-b38145f2-353f-43c8-8b7f-ff8d70adda36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71994663-7386-42fc-b512-59869acddfc0", "tag": "161ee285-50e1-41c3-8dac-779bdabe34a3"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-1dd2b4d7-7630-4f24-b16f-3391221319cc req-b38145f2-353f-43c8-8b7f-ff8d70adda36 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-1dd2b4d7-7630-4f24-b16f-3391221319cc req-b38145f2-353f-43c8-8b7f-ff8d70adda36 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-1dd2b4d7-7630-4f24-b16f-3391221319cc req-b38145f2-353f-43c8-8b7f-ff8d70adda36 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-1dd2b4d7-7630-4f24-b16f-3391221319cc req-b38145f2-353f-43c8-8b7f-ff8d70adda36 service nova] Creating event network-changed:161ee285-50e1-41c3-8dac-779bdabe34a3 for instance 71994663-7386-42fc-b512-59869acddfc0 on user Apr 20 15:15:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-1dd2b4d7-7630-4f24-b16f-3391221319cc req-b38145f2-353f-43c8-8b7f-ff8d70adda36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084368 Apr 20 15:15:45 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 96/283] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:15:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 15:15:47 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-69131fdd-0733-4e9c-aaa6-9e1ed1a6eb6b req-a903c3b4-ac89-4bbb-9d71-066a57dbc0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71994663-7386-42fc-b512-59869acddfc0", "name": "network-vif-plugged", "status": "completed", "tag": "161ee285-50e1-41c3-8dac-779bdabe34a3"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-69131fdd-0733-4e9c-aaa6-9e1ed1a6eb6b req-a903c3b4-ac89-4bbb-9d71-066a57dbc0d2 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-69131fdd-0733-4e9c-aaa6-9e1ed1a6eb6b req-a903c3b4-ac89-4bbb-9d71-066a57dbc0d2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-69131fdd-0733-4e9c-aaa6-9e1ed1a6eb6b req-a903c3b4-ac89-4bbb-9d71-066a57dbc0d2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:47 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-69131fdd-0733-4e9c-aaa6-9e1ed1a6eb6b req-a903c3b4-ac89-4bbb-9d71-066a57dbc0d2 service nova] Creating event network-vif-plugged:161ee285-50e1-41c3-8dac-779bdabe34a3 for instance 71994663-7386-42fc-b512-59869acddfc0 on user Apr 20 15:15:47 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-69131fdd-0733-4e9c-aaa6-9e1ed1a6eb6b req-a903c3b4-ac89-4bbb-9d71-066a57dbc0d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041601 Apr 20 15:15:47 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 94/284] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:15:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:15:49 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-e0376da3-2910-4044-8287-52a5b194c564 req-028e392f-b33e-4248-b0cd-76d0df9617d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71994663-7386-42fc-b512-59869acddfc0", "name": "network-vif-plugged", "status": "completed", "tag": "161ee285-50e1-41c3-8dac-779bdabe34a3"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:15:49 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:15:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-e0376da3-2910-4044-8287-52a5b194c564 req-028e392f-b33e-4248-b0cd-76d0df9617d2 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:15:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-e0376da3-2910-4044-8287-52a5b194c564 req-028e392f-b33e-4248-b0cd-76d0df9617d2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:15:49 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-e0376da3-2910-4044-8287-52a5b194c564 req-028e392f-b33e-4248-b0cd-76d0df9617d2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:15:49 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-e0376da3-2910-4044-8287-52a5b194c564 req-028e392f-b33e-4248-b0cd-76d0df9617d2 service nova] Creating event network-vif-plugged:161ee285-50e1-41c3-8dac-779bdabe34a3 for instance 71994663-7386-42fc-b512-59869acddfc0 on user Apr 20 15:15:49 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-e0376da3-2910-4044-8287-52a5b194c564 req-028e392f-b33e-4248-b0cd-76d0df9617d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032638 Apr 20 15:15:49 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 95/285] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:15:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f12429da-5f5c-486a-b3a0-60a21d1d80ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f12429da-5f5c-486a-b3a0-60a21d1d80ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f12429da-5f5c-486a-b3a0-60a21d1d80ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f12429da-5f5c-486a-b3a0-60a21d1d80ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f12429da-5f5c-486a-b3a0-60a21d1d80ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f12429da-5f5c-486a-b3a0-60a21d1d80ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f12429da-5f5c-486a-b3a0-60a21d1d80ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f12429da-5f5c-486a-b3a0-60a21d1d80ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:01 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-f12429da-5f5c-486a-b3a0-60a21d1d80ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515a83630b834f03a4fd748fb75b3550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d2444339049d0a0bb680f55ce75e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:01 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f12429da-5f5c-486a-b3a0-60a21d1d80ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82" status: 200 len: 1494 microversion: 2.1 time: 0.225824 Apr 20 15:16:01 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 97/286] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:16:01 2023] GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 => generated 1494 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=22 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-c5af1dfa-7eb2-4066-b276-cb83376a5479 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-c5af1dfa-7eb2-4066-b276-cb83376a5479 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-c5af1dfa-7eb2-4066-b276-cb83376a5479 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-c5af1dfa-7eb2-4066-b276-cb83376a5479 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-c5af1dfa-7eb2-4066-b276-cb83376a5479 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-c5af1dfa-7eb2-4066-b276-cb83376a5479 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-c5af1dfa-7eb2-4066-b276-cb83376a5479 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-c5af1dfa-7eb2-4066-b276-cb83376a5479 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:10 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-c5af1dfa-7eb2-4066-b276-cb83376a5479 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184443 Apr 20 15:16:10 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 95/287] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 15:16:10 2023] GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26/os-interface => generated 282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:11 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-78e896dd-c6a6-4ff1-987a-9ed7e729511a req-b03b597e-56a9-42e2-ae2a-b4f4140a3470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26", "tag": "22fdbf0e-d74b-4bfd-b575-a9df2ec357f6"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:11 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:11 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:11 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-78e896dd-c6a6-4ff1-987a-9ed7e729511a req-b03b597e-56a9-42e2-ae2a-b4f4140a3470 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:11 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-78e896dd-c6a6-4ff1-987a-9ed7e729511a req-b03b597e-56a9-42e2-ae2a-b4f4140a3470 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:11 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-78e896dd-c6a6-4ff1-987a-9ed7e729511a req-b03b597e-56a9-42e2-ae2a-b4f4140a3470 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:11 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-78e896dd-c6a6-4ff1-987a-9ed7e729511a req-b03b597e-56a9-42e2-ae2a-b4f4140a3470 service nova] Creating event network-changed:22fdbf0e-d74b-4bfd-b575-a9df2ec357f6 for instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 on user Apr 20 15:16:11 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-78e896dd-c6a6-4ff1-987a-9ed7e729511a req-b03b597e-56a9-42e2-ae2a-b4f4140a3470 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038949 Apr 20 15:16:11 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 96/288] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:11 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f3e43130-b15c-4afc-ab9c-0a7aa83afe0b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:11 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f3e43130-b15c-4afc-ab9c-0a7aa83afe0b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:11 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:11 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3e43130-b15c-4afc-ab9c-0a7aa83afe0b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3e43130-b15c-4afc-ab9c-0a7aa83afe0b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3e43130-b15c-4afc-ab9c-0a7aa83afe0b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3e43130-b15c-4afc-ab9c-0a7aa83afe0b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3e43130-b15c-4afc-ab9c-0a7aa83afe0b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3e43130-b15c-4afc-ab9c-0a7aa83afe0b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:11 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f3e43130-b15c-4afc-ab9c-0a7aa83afe0b tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26/ips" status: 200 len: 108 microversion: 2.1 time: 0.035537 Apr 20 15:16:11 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 98/289] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 15:16:11 2023] GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26/ips => generated 108 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-4ef758b6-1b72-4be5-bdf7-d9b2e0b52362 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:12 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-4ef758b6-1b72-4be5-bdf7-d9b2e0b52362 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4ef758b6-1b72-4be5-bdf7-d9b2e0b52362 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4ef758b6-1b72-4be5-bdf7-d9b2e0b52362 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4ef758b6-1b72-4be5-bdf7-d9b2e0b52362 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4ef758b6-1b72-4be5-bdf7-d9b2e0b52362 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4ef758b6-1b72-4be5-bdf7-d9b2e0b52362 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4ef758b6-1b72-4be5-bdf7-d9b2e0b52362 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:12 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-4ef758b6-1b72-4be5-bdf7-d9b2e0b52362 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] Going to try to terminate instance {{(pid=61509) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:16:13 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-4ef758b6-1b72-4be5-bdf7-d9b2e0b52362 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26" status: 204 len: 0 microversion: 2.1 time: 0.108250 Apr 20 15:16:13 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 96/290] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:16:12 2023] DELETE /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:16:13 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-b43f290f-095f-48e2-b17b-845730674e21 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:13 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-b43f290f-095f-48e2-b17b-845730674e21 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:13 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b43f290f-095f-48e2-b17b-845730674e21 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:13 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b43f290f-095f-48e2-b17b-845730674e21 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:13 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b43f290f-095f-48e2-b17b-845730674e21 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:13 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b43f290f-095f-48e2-b17b-845730674e21 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:13 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b43f290f-095f-48e2-b17b-845730674e21 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:13 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-b43f290f-095f-48e2-b17b-845730674e21 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:13 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-b43f290f-095f-48e2-b17b-845730674e21 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca4ca64cede4846a74e2cc4c13f3c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb81196155147cea0569f8a96465b6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:13 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-b43f290f-095f-48e2-b17b-845730674e21 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26" status: 200 len: 1667 microversion: 2.1 time: 0.259758 Apr 20 15:16:13 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 97/291] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:16:13 2023] GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 => generated 1667 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:16:13 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-b0f8b9d6-3621-48c7-a8c0-436355442e51 req-264c0d3c-48e5-4e8e-8fe0-21fdd49db2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26", "name": "network-vif-unplugged", "status": "completed", "tag": "22fdbf0e-d74b-4bfd-b575-a9df2ec357f6"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-b0f8b9d6-3621-48c7-a8c0-436355442e51 req-264c0d3c-48e5-4e8e-8fe0-21fdd49db2c4 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-b0f8b9d6-3621-48c7-a8c0-436355442e51 req-264c0d3c-48e5-4e8e-8fe0-21fdd49db2c4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-b0f8b9d6-3621-48c7-a8c0-436355442e51 req-264c0d3c-48e5-4e8e-8fe0-21fdd49db2c4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:13 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-b0f8b9d6-3621-48c7-a8c0-436355442e51 req-264c0d3c-48e5-4e8e-8fe0-21fdd49db2c4 service nova] Creating event network-vif-unplugged:22fdbf0e-d74b-4bfd-b575-a9df2ec357f6 for instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 on user Apr 20 15:16:13 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-b0f8b9d6-3621-48c7-a8c0-436355442e51 req-264c0d3c-48e5-4e8e-8fe0-21fdd49db2c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030275 Apr 20 15:16:13 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 99/292] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:14 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-1a911657-fe52-4cb7-82d4-e9ac6d43515e req-86feae05-9672-4f6f-a9ca-8f5633585d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26", "name": "network-vif-deleted", "tag": "22fdbf0e-d74b-4bfd-b575-a9df2ec357f6"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:14 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-1a911657-fe52-4cb7-82d4-e9ac6d43515e req-86feae05-9672-4f6f-a9ca-8f5633585d6d service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:14 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-1a911657-fe52-4cb7-82d4-e9ac6d43515e req-86feae05-9672-4f6f-a9ca-8f5633585d6d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:14 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-1a911657-fe52-4cb7-82d4-e9ac6d43515e req-86feae05-9672-4f6f-a9ca-8f5633585d6d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:14 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-1a911657-fe52-4cb7-82d4-e9ac6d43515e req-86feae05-9672-4f6f-a9ca-8f5633585d6d service nova] Creating event network-vif-deleted:22fdbf0e-d74b-4bfd-b575-a9df2ec357f6 for instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 on user Apr 20 15:16:14 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-1a911657-fe52-4cb7-82d4-e9ac6d43515e req-86feae05-9672-4f6f-a9ca-8f5633585d6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030783 Apr 20 15:16:14 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 97/293] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG nova.objects.instance [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lazy-loading 'fault' on Instance uuid 10e60ade-dd93-42f6-accf-d3d051fee951 {{(pid=61508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:15 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-f10addab-30ee-4f2a-91a7-624fd78414be tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e60ade-dd93-42f6-accf-d3d051fee951" status: 200 len: 1650 microversion: 2.87 time: 0.151761 Apr 20 15:16:15 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 98/294] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:16:15 2023] GET /compute/v2.1/servers/10e60ade-dd93-42f6-accf-d3d051fee951 => generated 1650 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:15 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] HTTP exception thrown: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Request method failure captured: Apr 20 15:16:15 user devstack@n-api.service[61509]: request: GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a HTTP/1.1 Apr 20 15:16:15 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:16:15 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:16:15 user devstack@n-api.service[61509]: Connection: close Apr 20 15:16:15 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:16:15 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:16:15 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:16:15 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:16:15 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVaYmQ7rYu1k3uG692uZxyih8IzIgtnYN18Z10C_0z2CG8bfjBibZDUn5Fk1hMa9cXN3ySp9G-ljaqvOLV0HqFOm7EpbcNOwW23fRjHMeSJUAB6TEl-QSpZM5QObD9jQhCH41PR7NRvucNqeIqHO3jHYbsHt0fYKU1udfi75q98MBq4 Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Project-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3bfe062836ab4f98866f6058a0a50f66"}]}] Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Tenant-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:16:15 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:16:15 user devstack@n-api.service[61509]: X-User: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:16:15 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:16:15 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:16:15 user devstack@n-api.service[61509]: X-User-Id: bbd3a1bdaa3d4259a7f578e485a929ef Apr 20 15:16:15 user devstack@n-api.service[61509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:16:15 user devstack@n-api.service[61509]: method: > Apr 20 15:16:15 user devstack@n-api.service[61509]: exception: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:16:15 user devstack@n-api.service[61509]: action_args: {'id': 'e3055a84-dc65-4914-9d37-69d65383784a'} Apr 20 15:16:15 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:16:15 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Returning 404 to user: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:16:15 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-e04eea00-833c-48a1-a3e8-fecdd30bc89c tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a" status: 404 len: 111 microversion: 2.20 time: 0.034139 Apr 20 15:16:15 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 98/295] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:16:15 2023] GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:16:15 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-188673e1-c9f4-444f-927a-1f36d547134f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '.version_select at 0x7fcbb37a5d80>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] Doing local delete in cell c9259cc4-6390-40ae-86fb-bec94ff13c9d(cell1) {{(pid=61510) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:15 user devstack@n-api.service[61510]: WARNING nova.compute.api [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] instance's host None is down, deleting from database Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-2fc8df55-e909-4872-93b5-3b61d47cf27b req-cf51b89f-636a-49df-8e3c-0904b7ddd187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26", "name": "network-vif-plugged", "status": "completed", "tag": "22fdbf0e-d74b-4bfd-b575-a9df2ec357f6"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] deallocate_for_instance() {{(pid=61510) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-2fc8df55-e909-4872-93b5-3b61d47cf27b req-cf51b89f-636a-49df-8e3c-0904b7ddd187 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-2fc8df55-e909-4872-93b5-3b61d47cf27b req-cf51b89f-636a-49df-8e3c-0904b7ddd187 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:15 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-2fc8df55-e909-4872-93b5-3b61d47cf27b req-cf51b89f-636a-49df-8e3c-0904b7ddd187 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:15 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-188673e1-c9f4-444f-927a-1f36d547134f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717500440" status: 204 len: 0 microversion: 2.20 time: 0.059544 Apr 20 15:16:15 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 99/296] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 20 15:16:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717500440 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 15:16:15 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-2fc8df55-e909-4872-93b5-3b61d47cf27b req-cf51b89f-636a-49df-8e3c-0904b7ddd187 service nova] Creating event network-vif-plugged:22fdbf0e-d74b-4bfd-b575-a9df2ec357f6 for instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 on user Apr 20 15:16:15 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-2fc8df55-e909-4872-93b5-3b61d47cf27b req-cf51b89f-636a-49df-8e3c-0904b7ddd187 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030967 Apr 20 15:16:15 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 99/297] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] Instance cache missing network info. {{(pid=61510) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] Updating instance_info_cache with network_info: [] {{(pid=61510) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 15:16:15 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61510) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 15:16:15 user devstack@n-api.service[61510]: WARNING nova.compute.api [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 15:16:16 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-9542f68e-502c-4917-9a44-1d3c7b0653c9 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10e60ade-dd93-42f6-accf-d3d051fee951" status: 204 len: 0 microversion: 2.87 time: 0.749002 Apr 20 15:16:16 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 100/298] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 15:16:15 2023] DELETE /compute/v2.1/servers/10e60ade-dd93-42f6-accf-d3d051fee951 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 10e60ade-dd93-42f6-accf-d3d051fee951] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:16 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] HTTP exception thrown: Instance 10e60ade-dd93-42f6-accf-d3d051fee951 could not be found. Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Request method failure captured: Apr 20 15:16:16 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/10e60ade-dd93-42f6-accf-d3d051fee951 HTTP/1.1 Apr 20 15:16:16 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:16:16 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:16:16 user devstack@n-api.service[61508]: Connection: close Apr 20 15:16:16 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:16:16 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:16:16 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:16:16 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:16:16 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVxifQhLh6haZF7OFMEa88rkO6musJzeutvw2tGr_aikmEOjg3pT-FNBOBwV498YHXxBJNjACcf12tEqz13zia3YO4cAGgfSGjJy_X1uYy36PSb-JYgh5guqGDK74Mv9iFGBgvQBtW5DMlIiMoqOYP6W54wS58GKKB1FquD3E95S_E Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Project-Id: b53c73dfc9094d05802c05b2f25d6bed Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53c73dfc9094d05802c05b2f25d6bed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53c73dfc9094d05802c05b2f25d6bed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b53c73dfc9094d05802c05b2f25d6bed"}]}] Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Tenant-Id: b53c73dfc9094d05802c05b2f25d6bed Apr 20 15:16:16 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:16:16 user devstack@n-api.service[61508]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member Apr 20 15:16:16 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:16:16 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:16:16 user devstack@n-api.service[61508]: X-User-Id: f19d8fcc1b69479992ff0d8bc5c99306 Apr 20 15:16:16 user devstack@n-api.service[61508]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member Apr 20 15:16:16 user devstack@n-api.service[61508]: method: > Apr 20 15:16:16 user devstack@n-api.service[61508]: exception: Instance 10e60ade-dd93-42f6-accf-d3d051fee951 could not be found. Apr 20 15:16:16 user devstack@n-api.service[61508]: action_args: {'id': '10e60ade-dd93-42f6-accf-d3d051fee951'} Apr 20 15:16:16 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e60ade-dd93-42f6-accf-d3d051fee951 could not be found. Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e60ade-dd93-42f6-accf-d3d051fee951 could not be found. Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e60ade-dd93-42f6-accf-d3d051fee951 could not be found. Apr 20 15:16:16 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Returning 404 to user: Instance 10e60ade-dd93-42f6-accf-d3d051fee951 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:16:16 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-149e153d-8efa-4e83-aca3-58839013537a tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10e60ade-dd93-42f6-accf-d3d051fee951" status: 404 len: 111 microversion: 2.87 time: 0.028145 Apr 20 15:16:16 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 100/299] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:16:16 2023] GET /compute/v2.1/servers/10e60ade-dd93-42f6-accf-d3d051fee951 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:16:16 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-774e52c3-59ed-4379-a4a5-e65a6f1197b2 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Action: 'create', calling method: .version_select at 0x7fcbb37531c0>, body: {"keypair": {"name": "tempest-keypair-1515762926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+BpA/QVEVcBhY96ueIlEAqUyydEjb3TDWpS9ZcpgBk3RCSCHqe6p1mnoiLGGvxBJ6G5pwKKupwEnIPM+KtK51qV5dgMSo5MG+lC07Z/uMsaxDcNxWiQ7ptcyduxSmR8Q=="}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:16 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-774e52c3-59ed-4379-a4a5-e65a6f1197b2 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Getting quotas for project 3bfe062836ab4f98866f6058a0a50f66. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:16:16 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-774e52c3-59ed-4379-a4a5-e65a6f1197b2 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Getting quotas for user bbd3a1bdaa3d4259a7f578e485a929ef and project 3bfe062836ab4f98866f6058a0a50f66. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:16:16 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-774e52c3-59ed-4379-a4a5-e65a6f1197b2 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.056729 Apr 20 15:16:16 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 100/300] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 15:16:16 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 15:16:16 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-63eab46b-9f13-4225-8a16-43bc8f22ca99 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:16 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-63eab46b-9f13-4225-8a16-43bc8f22ca99 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: a41b61b3-ec9a-492b-b137-95e320dee7d1] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:16 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-63eab46b-9f13-4225-8a16-43bc8f22ca99 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:16 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-63eab46b-9f13-4225-8a16-43bc8f22ca99 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:16 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-63eab46b-9f13-4225-8a16-43bc8f22ca99 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:16 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-63eab46b-9f13-4225-8a16-43bc8f22ca99 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:16 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-63eab46b-9f13-4225-8a16-43bc8f22ca99 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:16 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-63eab46b-9f13-4225-8a16-43bc8f22ca99 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:16 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-63eab46b-9f13-4225-8a16-43bc8f22ca99 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: a41b61b3-ec9a-492b-b137-95e320dee7d1] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:16:16 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-63eab46b-9f13-4225-8a16-43bc8f22ca99 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1" status: 204 len: 0 microversion: 2.87 time: 0.128476 Apr 20 15:16:16 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 101/301] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 15:16:16 2023] DELETE /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: a41b61b3-ec9a-492b-b137-95e320dee7d1] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:16 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-e9c773dc-f019-49dc-bb2c-551da2719cba req-5a8eb10b-da85-4568-8f6d-57902ea85681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41b61b3-ec9a-492b-b137-95e320dee7d1", "name": "network-vif-unplugged", "status": "completed", "tag": "b2623ec3-1a33-4c90-9e40-1f8298bbba37"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:16 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e9c773dc-f019-49dc-bb2c-551da2719cba req-5a8eb10b-da85-4568-8f6d-57902ea85681 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:16 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e9c773dc-f019-49dc-bb2c-551da2719cba req-5a8eb10b-da85-4568-8f6d-57902ea85681 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:16 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-e9c773dc-f019-49dc-bb2c-551da2719cba req-5a8eb10b-da85-4568-8f6d-57902ea85681 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:16 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-e9c773dc-f019-49dc-bb2c-551da2719cba req-5a8eb10b-da85-4568-8f6d-57902ea85681 service nova] Creating event network-vif-unplugged:b2623ec3-1a33-4c90-9e40-1f8298bbba37 for instance a41b61b3-ec9a-492b-b137-95e320dee7d1 on user Apr 20 15:16:16 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-e9c773dc-f019-49dc-bb2c-551da2719cba req-5a8eb10b-da85-4568-8f6d-57902ea85681 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029993 Apr 20 15:16:16 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 101/302] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:16 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:16 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-63d6d17e-0e02-426b-b9dd-4d5d3560de61 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1" status: 200 len: 1697 microversion: 2.87 time: 0.323871 Apr 20 15:16:16 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 101/303] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:16:16 2023] GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1 => generated 1697 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:16:18 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-f712ccfc-c344-4bfb-aa58-2d2264058d4d req-56cb07b2-c597-4d17-9978-607158edd7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41b61b3-ec9a-492b-b137-95e320dee7d1", "name": "network-vif-deleted", "tag": "b2623ec3-1a33-4c90-9e40-1f8298bbba37"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:18 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f712ccfc-c344-4bfb-aa58-2d2264058d4d req-56cb07b2-c597-4d17-9978-607158edd7c5 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:18 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f712ccfc-c344-4bfb-aa58-2d2264058d4d req-56cb07b2-c597-4d17-9978-607158edd7c5 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:18 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f712ccfc-c344-4bfb-aa58-2d2264058d4d req-56cb07b2-c597-4d17-9978-607158edd7c5 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:18 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-f712ccfc-c344-4bfb-aa58-2d2264058d4d req-56cb07b2-c597-4d17-9978-607158edd7c5 service nova] Creating event network-vif-deleted:b2623ec3-1a33-4c90-9e40-1f8298bbba37 for instance a41b61b3-ec9a-492b-b137-95e320dee7d1 on user Apr 20 15:16:18 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-f712ccfc-c344-4bfb-aa58-2d2264058d4d req-56cb07b2-c597-4d17-9978-607158edd7c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030063 Apr 20 15:16:18 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 102/304] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-928308817", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "36cd0028-b711-4f91-837b-b0bef4168afd"}], "security_groups": [{"name": "tempest-securitygroup--1934399328"}], "key_name": "tempest-keypair-1515762926", "user_data": "}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG nova.network.neutron [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] validate_networks() for [('36cd0028-b711-4f91-837b-b0bef4168afd', None, None, None, None, None)] {{(pid=61509) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:16:18 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-5f4854dc-4d98-4b8b-aa4e-982d2aabb760 req-ce39cfc8-0425-416f-9f1a-e8a938d251a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41b61b3-ec9a-492b-b137-95e320dee7d1", "name": "network-vif-plugged", "status": "completed", "tag": "b2623ec3-1a33-4c90-9e40-1f8298bbba37"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:18 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-5f4854dc-4d98-4b8b-aa4e-982d2aabb760 req-ce39cfc8-0425-416f-9f1a-e8a938d251a1 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:18 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-5f4854dc-4d98-4b8b-aa4e-982d2aabb760 req-ce39cfc8-0425-416f-9f1a-e8a938d251a1 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:18 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-5f4854dc-4d98-4b8b-aa4e-982d2aabb760 req-ce39cfc8-0425-416f-9f1a-e8a938d251a1 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:18 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-5f4854dc-4d98-4b8b-aa4e-982d2aabb760 req-ce39cfc8-0425-416f-9f1a-e8a938d251a1 service nova] Creating event network-vif-plugged:b2623ec3-1a33-4c90-9e40-1f8298bbba37 for instance a41b61b3-ec9a-492b-b137-95e320dee7d1 on user Apr 20 15:16:18 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-5f4854dc-4d98-4b8b-aa4e-982d2aabb760 req-ce39cfc8-0425-416f-9f1a-e8a938d251a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029068 Apr 20 15:16:18 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 102/305] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Flavor limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Image limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Flavor pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Image pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:19 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Getting quotas for project 3bfe062836ab4f98866f6058a0a50f66. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:16:19 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Getting quotas for user bbd3a1bdaa3d4259a7f578e485a929ef and project 3bfe062836ab4f98866f6058a0a50f66. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:16:19 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Going to run 1 instances... {{(pid=61509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:16:19 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:16:19 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-448558de-e04c-4ec1-984a-bad79373d7cd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.886835 Apr 20 15:16:19 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 102/306] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 15:16:18 2023] POST /compute/v2.1/servers => generated 400 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 15:16:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f2a3ea7a-b7a5-4c2d-96cc-c9b62584fb37 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:19 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f2a3ea7a-b7a5-4c2d-96cc-c9b62584fb37 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:19 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-f2a3ea7a-b7a5-4c2d-96cc-c9b62584fb37 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:19 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-f2a3ea7a-b7a5-4c2d-96cc-c9b62584fb37 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:19 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-f2a3ea7a-b7a5-4c2d-96cc-c9b62584fb37 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:19 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f2a3ea7a-b7a5-4c2d-96cc-c9b62584fb37 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3" status: 200 len: 1275 microversion: 2.20 time: 0.068808 Apr 20 15:16:19 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 103/307] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:16:19 2023] GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 => generated 1275 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:16:21 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-e4e2a87e-af12-445c-8cbe-7155e802f96c req-9fbe1df3-24da-48c6-a348-2a76d76bb4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff56ab94-63cf-4527-a46f-aa0a2adfcdc3", "tag": "791f0522-477d-4e2a-baed-c3d02080a144"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-e4e2a87e-af12-445c-8cbe-7155e802f96c req-9fbe1df3-24da-48c6-a348-2a76d76bb4ed service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-e4e2a87e-af12-445c-8cbe-7155e802f96c req-9fbe1df3-24da-48c6-a348-2a76d76bb4ed service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:21 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-e4e2a87e-af12-445c-8cbe-7155e802f96c req-9fbe1df3-24da-48c6-a348-2a76d76bb4ed service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:21 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-e4e2a87e-af12-445c-8cbe-7155e802f96c req-9fbe1df3-24da-48c6-a348-2a76d76bb4ed service nova] Creating event network-changed:791f0522-477d-4e2a-baed-c3d02080a144 for instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 on user Apr 20 15:16:21 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-e4e2a87e-af12-445c-8cbe-7155e802f96c req-9fbe1df3-24da-48c6-a348-2a76d76bb4ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029784 Apr 20 15:16:21 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 103/308] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:23 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-288b0755-445a-4831-b4e0-d3809666e6f6 req-6a83c1e1-72f6-422f-a26a-0b829348676b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff56ab94-63cf-4527-a46f-aa0a2adfcdc3", "name": "network-vif-plugged", "status": "completed", "tag": "791f0522-477d-4e2a-baed-c3d02080a144"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:23 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-288b0755-445a-4831-b4e0-d3809666e6f6 req-6a83c1e1-72f6-422f-a26a-0b829348676b service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:23 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-288b0755-445a-4831-b4e0-d3809666e6f6 req-6a83c1e1-72f6-422f-a26a-0b829348676b service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:23 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-288b0755-445a-4831-b4e0-d3809666e6f6 req-6a83c1e1-72f6-422f-a26a-0b829348676b service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:23 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-288b0755-445a-4831-b4e0-d3809666e6f6 req-6a83c1e1-72f6-422f-a26a-0b829348676b service nova] Creating event network-vif-plugged:791f0522-477d-4e2a-baed-c3d02080a144 for instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 on user Apr 20 15:16:23 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-288b0755-445a-4831-b4e0-d3809666e6f6 req-6a83c1e1-72f6-422f-a26a-0b829348676b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043905 Apr 20 15:16:23 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 103/309] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:25 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-97a07174-f8fd-434f-b922-d3f59b07b057 req-08e23c90-fa7e-41b3-bb75-4dc73e990bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff56ab94-63cf-4527-a46f-aa0a2adfcdc3", "name": "network-vif-plugged", "status": "completed", "tag": "791f0522-477d-4e2a-baed-c3d02080a144"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-97a07174-f8fd-434f-b922-d3f59b07b057 req-08e23c90-fa7e-41b3-bb75-4dc73e990bcc service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-97a07174-f8fd-434f-b922-d3f59b07b057 req-08e23c90-fa7e-41b3-bb75-4dc73e990bcc service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-97a07174-f8fd-434f-b922-d3f59b07b057 req-08e23c90-fa7e-41b3-bb75-4dc73e990bcc service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-97a07174-f8fd-434f-b922-d3f59b07b057 req-08e23c90-fa7e-41b3-bb75-4dc73e990bcc service nova] Creating event network-vif-plugged:791f0522-477d-4e2a-baed-c3d02080a144 for instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 on user Apr 20 15:16:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-97a07174-f8fd-434f-b922-d3f59b07b057 req-08e23c90-fa7e-41b3-bb75-4dc73e990bcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028329 Apr 20 15:16:25 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 104/310] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=30 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-c97444ed-f40b-4f23-a221-40d42138851c tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-c97444ed-f40b-4f23-a221-40d42138851c tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] [instance: 71994663-7386-42fc-b512-59869acddfc0] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c97444ed-f40b-4f23-a221-40d42138851c tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c97444ed-f40b-4f23-a221-40d42138851c tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c97444ed-f40b-4f23-a221-40d42138851c tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c97444ed-f40b-4f23-a221-40d42138851c tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c97444ed-f40b-4f23-a221-40d42138851c tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-c97444ed-f40b-4f23-a221-40d42138851c tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:32 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-c97444ed-f40b-4f23-a221-40d42138851c tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2b076c0e354876981854fbadcc4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3b0b5be268475b92a96fcc1b02094e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:32 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-c97444ed-f40b-4f23-a221-40d42138851c tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0" status: 200 len: 1567 microversion: 2.1 time: 0.229178 Apr 20 15:16:32 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 104/311] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:16:32 2023] GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=10 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-9b7efff1-3645-4fec-b012-2fd641c1a4ea tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-9b7efff1-3645-4fec-b012-2fd641c1a4ea tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 66242fcd-cd65-442b-8643-b33fe81a8061] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9b7efff1-3645-4fec-b012-2fd641c1a4ea tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9b7efff1-3645-4fec-b012-2fd641c1a4ea tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9b7efff1-3645-4fec-b012-2fd641c1a4ea tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9b7efff1-3645-4fec-b012-2fd641c1a4ea tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9b7efff1-3645-4fec-b012-2fd641c1a4ea tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9b7efff1-3645-4fec-b012-2fd641c1a4ea tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:33 user devstack@n-api.service[61509]: DEBUG nova.objects.instance [None req-9b7efff1-3645-4fec-b012-2fd641c1a4ea tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lazy-loading 'flavor' on Instance uuid 66242fcd-cd65-442b-8643-b33fe81a8061 {{(pid=61509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 15:16:33 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-9b7efff1-3645-4fec-b012-2fd641c1a4ea tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "POST /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061/action" status: 200 len: 32 microversion: 2.1 time: 0.173761 Apr 20 15:16:33 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 104/312] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 15:16:33 2023] POST /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 15:16:33 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:16:33 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b46bba88-76df-4c53-8436-c8d12967bf71 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:33 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b46bba88-76df-4c53-8436-c8d12967bf71 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 66242fcd-cd65-442b-8643-b33fe81a8061] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b46bba88-76df-4c53-8436-c8d12967bf71 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b46bba88-76df-4c53-8436-c8d12967bf71 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b46bba88-76df-4c53-8436-c8d12967bf71 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b46bba88-76df-4c53-8436-c8d12967bf71 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b46bba88-76df-4c53-8436-c8d12967bf71 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b46bba88-76df-4c53-8436-c8d12967bf71 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:33 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-b46bba88-76df-4c53-8436-c8d12967bf71 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02e13ff5394016b693bfb61c0dd244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277c8babb24c43c6b386883035b7476c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:33 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b46bba88-76df-4c53-8436-c8d12967bf71 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061" status: 200 len: 1509 microversion: 2.1 time: 0.308608 Apr 20 15:16:33 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 105/313] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:16:33 2023] GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061 => generated 1509 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:16:34 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-58291c70-47d3-42e9-99c8-60909724a520 req-87ae230a-e002-4012-9266-375009298b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66242fcd-cd65-442b-8643-b33fe81a8061", "name": "network-vif-unplugged", "status": "completed", "tag": "fa3c5cc7-be23-4a32-823e-086e69742eda"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-58291c70-47d3-42e9-99c8-60909724a520 req-87ae230a-e002-4012-9266-375009298b0a service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-58291c70-47d3-42e9-99c8-60909724a520 req-87ae230a-e002-4012-9266-375009298b0a service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-58291c70-47d3-42e9-99c8-60909724a520 req-87ae230a-e002-4012-9266-375009298b0a service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:34 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-58291c70-47d3-42e9-99c8-60909724a520 req-87ae230a-e002-4012-9266-375009298b0a service nova] Creating event network-vif-unplugged:fa3c5cc7-be23-4a32-823e-086e69742eda for instance 66242fcd-cd65-442b-8643-b33fe81a8061 on user Apr 20 15:16:34 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-58291c70-47d3-42e9-99c8-60909724a520 req-87ae230a-e002-4012-9266-375009298b0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035745 Apr 20 15:16:34 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 105/314] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:36 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-a7b0a16b-a4d5-42bb-83f9-7522ef3692a1 req-3f801878-6d0f-4842-8835-76751f3b8db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66242fcd-cd65-442b-8643-b33fe81a8061", "name": "network-vif-plugged", "status": "completed", "tag": "fa3c5cc7-be23-4a32-823e-086e69742eda"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:36 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-a7b0a16b-a4d5-42bb-83f9-7522ef3692a1 req-3f801878-6d0f-4842-8835-76751f3b8db3 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:36 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-a7b0a16b-a4d5-42bb-83f9-7522ef3692a1 req-3f801878-6d0f-4842-8835-76751f3b8db3 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:36 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-a7b0a16b-a4d5-42bb-83f9-7522ef3692a1 req-3f801878-6d0f-4842-8835-76751f3b8db3 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:36 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-a7b0a16b-a4d5-42bb-83f9-7522ef3692a1 req-3f801878-6d0f-4842-8835-76751f3b8db3 service nova] Creating event network-vif-plugged:fa3c5cc7-be23-4a32-823e-086e69742eda for instance 66242fcd-cd65-442b-8643-b33fe81a8061 on user Apr 20 15:16:36 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-a7b0a16b-a4d5-42bb-83f9-7522ef3692a1 req-3f801878-6d0f-4842-8835-76751f3b8db3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033521 Apr 20 15:16:36 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 105/315] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:16:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b6e7621b-5237-4234-9aa6-94f4ee7d01fd tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:16:37 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b6e7621b-5237-4234-9aa6-94f4ee7d01fd tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:16:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b6e7621b-5237-4234-9aa6-94f4ee7d01fd tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b6e7621b-5237-4234-9aa6-94f4ee7d01fd tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b6e7621b-5237-4234-9aa6-94f4ee7d01fd tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b6e7621b-5237-4234-9aa6-94f4ee7d01fd tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b6e7621b-5237-4234-9aa6-94f4ee7d01fd tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b6e7621b-5237-4234-9aa6-94f4ee7d01fd tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:38 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-b6e7621b-5237-4234-9aa6-94f4ee7d01fd tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:16:38 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b6e7621b-5237-4234-9aa6-94f4ee7d01fd tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1658 microversion: 2.1 time: 0.211614 Apr 20 15:16:38 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:16:37 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1658 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:16:38 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-11332560-b3f1-4524-8ce8-ac7bfbeb1fdb req-7fcc165a-adac-4043-90d1-8f8e58e3073b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66242fcd-cd65-442b-8643-b33fe81a8061", "name": "network-vif-plugged", "status": "completed", "tag": "fa3c5cc7-be23-4a32-823e-086e69742eda"}, {"server_uuid": "66242fcd-cd65-442b-8643-b33fe81a8061", "name": "network-vif-plugged", "status": "completed", "tag": "fa3c5cc7-be23-4a32-823e-086e69742eda"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:16:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-11332560-b3f1-4524-8ce8-ac7bfbeb1fdb req-7fcc165a-adac-4043-90d1-8f8e58e3073b service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:16:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-11332560-b3f1-4524-8ce8-ac7bfbeb1fdb req-7fcc165a-adac-4043-90d1-8f8e58e3073b service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:16:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-11332560-b3f1-4524-8ce8-ac7bfbeb1fdb req-7fcc165a-adac-4043-90d1-8f8e58e3073b service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:16:38 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-11332560-b3f1-4524-8ce8-ac7bfbeb1fdb req-7fcc165a-adac-4043-90d1-8f8e58e3073b service nova] Creating event network-vif-plugged:fa3c5cc7-be23-4a32-823e-086e69742eda for instance 66242fcd-cd65-442b-8643-b33fe81a8061 on user Apr 20 15:16:38 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-11332560-b3f1-4524-8ce8-ac7bfbeb1fdb req-7fcc165a-adac-4043-90d1-8f8e58e3073b service nova] Creating event network-vif-plugged:fa3c5cc7-be23-4a32-823e-086e69742eda for instance 66242fcd-cd65-442b-8643-b33fe81a8061 on user Apr 20 15:16:38 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-11332560-b3f1-4524-8ce8-ac7bfbeb1fdb req-7fcc165a-adac-4043-90d1-8f8e58e3073b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041331 Apr 20 15:16:38 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 106/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:16:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:17:02 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:02 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:02 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-df088797-49cc-4424-864f-78369e7c67de tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:02 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-df088797-49cc-4424-864f-78369e7c67de tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:02 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-df088797-49cc-4424-864f-78369e7c67de tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:02 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-df088797-49cc-4424-864f-78369e7c67de tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:02 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-df088797-49cc-4424-864f-78369e7c67de tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:02 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-df088797-49cc-4424-864f-78369e7c67de tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:02 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-df088797-49cc-4424-864f-78369e7c67de tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:02 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-df088797-49cc-4424-864f-78369e7c67de tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:03 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-df088797-49cc-4424-864f-78369e7c67de tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515a83630b834f03a4fd748fb75b3550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d2444339049d0a0bb680f55ce75e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:03 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-df088797-49cc-4424-864f-78369e7c67de tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82" status: 200 len: 1494 microversion: 2.1 time: 0.245227 Apr 20 15:17:03 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 106/318] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:17:02 2023] GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 => generated 1494 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=19,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] HTTP exception thrown: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Request method failure captured: Apr 20 15:17:03 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 HTTP/1.1 Apr 20 15:17:03 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:17:03 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:17:03 user devstack@n-api.service[61510]: Connection: close Apr 20 15:17:03 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:17:03 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:17:03 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:17:03 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:17:03 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVVx-U3QuV56Gy0TyipJvTPOcFQQTpehiuNsftdc0T5QMNXwtHTigVlX6LYAeTyjlobrUG05VFTlPrv0JZi9TUXTchee5Zjkc8RQE1BVwMrQG1dhl_fNaPnphr8mz74teZGGMRCnAaE9JAkOBDCXRc0vrPyW0Iq_TLcRQUBNHMdGhkE Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Project-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bb81196155147cea0569f8a96465b6a"}]}] Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Tenant-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:03 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:03 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:03 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:17:03 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:17:03 user devstack@n-api.service[61510]: X-User-Id: 8ca4ca64cede4846a74e2cc4c13f3c14 Apr 20 15:17:03 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:03 user devstack@n-api.service[61510]: method: > Apr 20 15:17:03 user devstack@n-api.service[61510]: exception: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:03 user devstack@n-api.service[61510]: action_args: {'id': 'b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26'} Apr 20 15:17:03 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Returning 404 to user: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:17:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-6de1e321-f7c0-4829-9fcb-08d1fe75ca91 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26" status: 404 len: 111 microversion: 2.1 time: 0.040806 Apr 20 15:17:03 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 107/319] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:17:03 2023] GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:17:03 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:03 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=10 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:03 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-fd8d886b-024c-40b7-832a-7f8d28c5d686 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '.version_select at 0x7fcbb37a5d80>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:03 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-fd8d886b-024c-40b7-832a-7f8d28c5d686 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-221995507" status: 202 len: 0 microversion: 2.1 time: 0.028431 Apr 20 15:17:03 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 107/320] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 15:17:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-221995507 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] HTTP exception thrown: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Request method failure captured: Apr 20 15:17:04 user devstack@n-api.service[61509]: request: DELETE /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 HTTP/1.1 Apr 20 15:17:04 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:17:04 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:17:04 user devstack@n-api.service[61509]: Connection: close Apr 20 15:17:04 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:17:04 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:17:04 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:17:04 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:17:04 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVVx-U3QuV56Gy0TyipJvTPOcFQQTpehiuNsftdc0T5QMNXwtHTigVlX6LYAeTyjlobrUG05VFTlPrv0JZi9TUXTchee5Zjkc8RQE1BVwMrQG1dhl_fNaPnphr8mz74teZGGMRCnAaE9JAkOBDCXRc0vrPyW0Iq_TLcRQUBNHMdGhkE Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Project-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Project-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bb81196155147cea0569f8a96465b6a"}]}] Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Tenant: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Tenant-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61509]: X-User: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61509]: X-User-Id: 8ca4ca64cede4846a74e2cc4c13f3c14 Apr 20 15:17:04 user devstack@n-api.service[61509]: X-User-Name: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61509]: method: > Apr 20 15:17:04 user devstack@n-api.service[61509]: exception: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61509]: action_args: {'id': 'b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26'} Apr 20 15:17:04 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Returning 404 to user: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:17:04 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-91ae880f-196d-434b-a04b-d59acdb03ab2 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26" status: 404 len: 111 microversion: 2.1 time: 0.028403 Apr 20 15:17:04 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 107/321] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:17:04 2023] DELETE /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] HTTP exception thrown: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Request method failure captured: Apr 20 15:17:04 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 HTTP/1.1 Apr 20 15:17:04 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:17:04 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:17:04 user devstack@n-api.service[61510]: Connection: close Apr 20 15:17:04 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:17:04 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:17:04 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:17:04 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:17:04 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVVx-U3QuV56Gy0TyipJvTPOcFQQTpehiuNsftdc0T5QMNXwtHTigVlX6LYAeTyjlobrUG05VFTlPrv0JZi9TUXTchee5Zjkc8RQE1BVwMrQG1dhl_fNaPnphr8mz74teZGGMRCnAaE9JAkOBDCXRc0vrPyW0Iq_TLcRQUBNHMdGhkE Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Project-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bb81196155147cea0569f8a96465b6a"}]}] Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Tenant-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61510]: X-User-Id: 8ca4ca64cede4846a74e2cc4c13f3c14 Apr 20 15:17:04 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61510]: method: > Apr 20 15:17:04 user devstack@n-api.service[61510]: exception: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61510]: action_args: {'id': 'b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26'} Apr 20 15:17:04 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Returning 404 to user: Instance b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:17:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-ac9caca7-372e-4aff-a9c5-fee2a7db9083 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26" status: 404 len: 111 microversion: 2.1 time: 0.031458 Apr 20 15:17:04 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 108/322] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:17:04 2023] GET /compute/v2.1/servers/b0bf277c-d09a-4f7a-87bf-a9b7d4a07b26 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] HTTP exception thrown: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Request method failure captured: Apr 20 15:17:04 user devstack@n-api.service[61508]: request: DELETE /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f HTTP/1.1 Apr 20 15:17:04 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:17:04 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:17:04 user devstack@n-api.service[61508]: Connection: close Apr 20 15:17:04 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:17:04 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:17:04 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:17:04 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:17:04 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVx-U3QuV56Gy0TyipJvTPOcFQQTpehiuNsftdc0T5QMNXwtHTigVlX6LYAeTyjlobrUG05VFTlPrv0JZi9TUXTchee5Zjkc8RQE1BVwMrQG1dhl_fNaPnphr8mz74teZGGMRCnAaE9JAkOBDCXRc0vrPyW0Iq_TLcRQUBNHMdGhkE Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Project-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Project-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bb81196155147cea0569f8a96465b6a"}]}] Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Tenant: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Tenant-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61508]: X-User: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61508]: X-User-Id: 8ca4ca64cede4846a74e2cc4c13f3c14 Apr 20 15:17:04 user devstack@n-api.service[61508]: X-User-Name: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61508]: method: > Apr 20 15:17:04 user devstack@n-api.service[61508]: exception: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:17:04 user devstack@n-api.service[61508]: action_args: {'id': '77755cf9-9e1b-4a77-a1e2-628876c5e06f'} Apr 20 15:17:04 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Returning 404 to user: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:17:04 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-847aa2f2-1948-4f75-81fb-72be62e330fe tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f" status: 404 len: 111 microversion: 2.1 time: 0.029980 Apr 20 15:17:04 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 108/323] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:17:04 2023] DELETE /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 77755cf9-9e1b-4a77-a1e2-628876c5e06f] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] HTTP exception thrown: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Request method failure captured: Apr 20 15:17:04 user devstack@n-api.service[61509]: request: GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f HTTP/1.1 Apr 20 15:17:04 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:17:04 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:17:04 user devstack@n-api.service[61509]: Connection: close Apr 20 15:17:04 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:17:04 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:17:04 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:17:04 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:17:04 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVVx-U3QuV56Gy0TyipJvTPOcFQQTpehiuNsftdc0T5QMNXwtHTigVlX6LYAeTyjlobrUG05VFTlPrv0JZi9TUXTchee5Zjkc8RQE1BVwMrQG1dhl_fNaPnphr8mz74teZGGMRCnAaE9JAkOBDCXRc0vrPyW0Iq_TLcRQUBNHMdGhkE Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Project-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Project-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bb81196155147cea0569f8a96465b6a"}]}] Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Tenant: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Tenant-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61509]: X-User: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61509]: X-User-Id: 8ca4ca64cede4846a74e2cc4c13f3c14 Apr 20 15:17:04 user devstack@n-api.service[61509]: X-User-Name: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61509]: method: > Apr 20 15:17:04 user devstack@n-api.service[61509]: exception: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:17:04 user devstack@n-api.service[61509]: action_args: {'id': '77755cf9-9e1b-4a77-a1e2-628876c5e06f'} Apr 20 15:17:04 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. Apr 20 15:17:04 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Returning 404 to user: Instance 77755cf9-9e1b-4a77-a1e2-628876c5e06f could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:17:04 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-0ce5a7af-9377-42bb-b174-5c3461b21ad0 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f" status: 404 len: 111 microversion: 2.1 time: 0.027472 Apr 20 15:17:04 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 108/324] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:17:04 2023] GET /compute/v2.1/servers/77755cf9-9e1b-4a77-a1e2-628876c5e06f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] HTTP exception thrown: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Request method failure captured: Apr 20 15:17:04 user devstack@n-api.service[61510]: request: DELETE /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79 HTTP/1.1 Apr 20 15:17:04 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:17:04 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:17:04 user devstack@n-api.service[61510]: Connection: close Apr 20 15:17:04 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:17:04 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:17:04 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:17:04 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:17:04 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVVx-U3QuV56Gy0TyipJvTPOcFQQTpehiuNsftdc0T5QMNXwtHTigVlX6LYAeTyjlobrUG05VFTlPrv0JZi9TUXTchee5Zjkc8RQE1BVwMrQG1dhl_fNaPnphr8mz74teZGGMRCnAaE9JAkOBDCXRc0vrPyW0Iq_TLcRQUBNHMdGhkE Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Project-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bb81196155147cea0569f8a96465b6a"}]}] Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Tenant-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61510]: X-User-Id: 8ca4ca64cede4846a74e2cc4c13f3c14 Apr 20 15:17:04 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61510]: method: > Apr 20 15:17:04 user devstack@n-api.service[61510]: exception: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61510]: action_args: {'id': '88f6bf8b-960a-462d-9a05-05f7e4f42f79'} Apr 20 15:17:04 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Returning 404 to user: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:17:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-71e48309-d08f-4d56-948e-7fa6f79c97e4 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79" status: 404 len: 111 microversion: 2.1 time: 0.026379 Apr 20 15:17:04 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 109/325] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:17:04 2023] DELETE /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] [instance: 88f6bf8b-960a-462d-9a05-05f7e4f42f79] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:04 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] HTTP exception thrown: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Request method failure captured: Apr 20 15:17:04 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79 HTTP/1.1 Apr 20 15:17:04 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:17:04 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:17:04 user devstack@n-api.service[61508]: Connection: close Apr 20 15:17:04 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:17:04 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:17:04 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:17:04 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:17:04 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVVx-U3QuV56Gy0TyipJvTPOcFQQTpehiuNsftdc0T5QMNXwtHTigVlX6LYAeTyjlobrUG05VFTlPrv0JZi9TUXTchee5Zjkc8RQE1BVwMrQG1dhl_fNaPnphr8mz74teZGGMRCnAaE9JAkOBDCXRc0vrPyW0Iq_TLcRQUBNHMdGhkE Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Project-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Project-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bb81196155147cea0569f8a96465b6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bb81196155147cea0569f8a96465b6a"}]}] Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Tenant: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Tenant-Id: 5bb81196155147cea0569f8a96465b6a Apr 20 15:17:04 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490231151 Apr 20 15:17:04 user devstack@n-api.service[61508]: X-User: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:17:04 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:17:04 user devstack@n-api.service[61508]: X-User-Id: 8ca4ca64cede4846a74e2cc4c13f3c14 Apr 20 15:17:04 user devstack@n-api.service[61508]: X-User-Name: tempest-AttachVolumeNegativeTest-490231151-project-member Apr 20 15:17:04 user devstack@n-api.service[61508]: method: > Apr 20 15:17:04 user devstack@n-api.service[61508]: exception: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61508]: action_args: {'id': '88f6bf8b-960a-462d-9a05-05f7e4f42f79'} Apr 20 15:17:04 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. Apr 20 15:17:04 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:17:04 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] Returning 404 to user: Instance 88f6bf8b-960a-462d-9a05-05f7e4f42f79 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:17:04 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-4ce635f3-379c-4e6f-a2e5-59f048987e70 tempest-AttachVolumeNegativeTest-490231151 tempest-AttachVolumeNegativeTest-490231151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79" status: 404 len: 111 microversion: 2.1 time: 0.032847 Apr 20 15:17:04 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 109/326] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:17:04 2023] GET /compute/v2.1/servers/88f6bf8b-960a-462d-9a05-05f7e4f42f79 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:17:06 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:06 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: a41b61b3-ec9a-492b-b137-95e320dee7d1] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:06 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] HTTP exception thrown: Instance a41b61b3-ec9a-492b-b137-95e320dee7d1 could not be found. Apr 20 15:17:06 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Request method failure captured: Apr 20 15:17:06 user devstack@n-api.service[61509]: request: GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1 HTTP/1.1 Apr 20 15:17:06 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:17:06 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:17:06 user devstack@n-api.service[61509]: Connection: close Apr 20 15:17:06 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:17:06 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:17:06 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:17:06 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:17:06 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVVxifQhLh6haZF7OFMEa88rkO6musJzeutvw2tGr_aikmEOjg3pT-FNBOBwV498YHXxBJNjACcf12tEqz13zia3YO4cAGgfSGjJy_X1uYy36PSb-JYgh5guqGDK74Mv9iFGBgvQBtW5DMlIiMoqOYP6W54wS58GKKB1FquD3E95S_E Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Project-Id: b53c73dfc9094d05802c05b2f25d6bed Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53c73dfc9094d05802c05b2f25d6bed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53c73dfc9094d05802c05b2f25d6bed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b53c73dfc9094d05802c05b2f25d6bed"}]}] Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Tenant-Id: b53c73dfc9094d05802c05b2f25d6bed Apr 20 15:17:06 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:17:06 user devstack@n-api.service[61509]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member Apr 20 15:17:06 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:17:06 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:17:06 user devstack@n-api.service[61509]: X-User-Id: f19d8fcc1b69479992ff0d8bc5c99306 Apr 20 15:17:06 user devstack@n-api.service[61509]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member Apr 20 15:17:06 user devstack@n-api.service[61509]: method: > Apr 20 15:17:06 user devstack@n-api.service[61509]: exception: Instance a41b61b3-ec9a-492b-b137-95e320dee7d1 could not be found. Apr 20 15:17:06 user devstack@n-api.service[61509]: action_args: {'id': 'a41b61b3-ec9a-492b-b137-95e320dee7d1'} Apr 20 15:17:06 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41b61b3-ec9a-492b-b137-95e320dee7d1 could not be found. Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41b61b3-ec9a-492b-b137-95e320dee7d1 could not be found. Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41b61b3-ec9a-492b-b137-95e320dee7d1 could not be found. Apr 20 15:17:06 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:06 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Returning 404 to user: Instance a41b61b3-ec9a-492b-b137-95e320dee7d1 could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:17:06 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-31904b27-06cc-4881-a6f1-4f0b113fef4b tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1" status: 404 len: 111 microversion: 2.87 time: 0.029897 Apr 20 15:17:06 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 109/327] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:17:06 2023] GET /compute/v2.1/servers/a41b61b3-ec9a-492b-b137-95e320dee7d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:17:07 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-d8c88792-4c5b-4050-a194-23251182d0fb tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:07 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-d8c88792-4c5b-4050-a194-23251182d0fb tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 36c4e175-7373-4a71-85b1-2b6b56ed2d2b] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d8c88792-4c5b-4050-a194-23251182d0fb tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d8c88792-4c5b-4050-a194-23251182d0fb tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d8c88792-4c5b-4050-a194-23251182d0fb tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d8c88792-4c5b-4050-a194-23251182d0fb tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d8c88792-4c5b-4050-a194-23251182d0fb tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d8c88792-4c5b-4050-a194-23251182d0fb tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:07 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-d8c88792-4c5b-4050-a194-23251182d0fb tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 36c4e175-7373-4a71-85b1-2b6b56ed2d2b] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:17:07 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-d8c88792-4c5b-4050-a194-23251182d0fb tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b" status: 204 len: 0 microversion: 2.87 time: 0.113576 Apr 20 15:17:07 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 110/328] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 15:17:07 2023] DELETE /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 36c4e175-7373-4a71-85b1-2b6b56ed2d2b] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:07 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-2330d556-41a3-4c84-b9a0-936b0d30e3d7 req-ec184a9c-25e0-448b-8e74-10cf316710ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4e175-7373-4a71-85b1-2b6b56ed2d2b", "name": "network-vif-unplugged", "status": "completed", "tag": "c24699b2-379d-421e-9cda-e7c230f9778d"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:17:07 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-2330d556-41a3-4c84-b9a0-936b0d30e3d7 req-ec184a9c-25e0-448b-8e74-10cf316710ee service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:07 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-2330d556-41a3-4c84-b9a0-936b0d30e3d7 req-ec184a9c-25e0-448b-8e74-10cf316710ee service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:07 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-2330d556-41a3-4c84-b9a0-936b0d30e3d7 req-ec184a9c-25e0-448b-8e74-10cf316710ee service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:07 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-2330d556-41a3-4c84-b9a0-936b0d30e3d7 req-ec184a9c-25e0-448b-8e74-10cf316710ee service nova] Creating event network-vif-unplugged:c24699b2-379d-421e-9cda-e7c230f9778d for instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b on user Apr 20 15:17:07 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-2330d556-41a3-4c84-b9a0-936b0d30e3d7 req-ec184a9c-25e0-448b-8e74-10cf316710ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034845 Apr 20 15:17:07 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 110/329] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:17:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:07 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f19d8fcc1b69479992ff0d8bc5c99306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c73dfc9094d05802c05b2f25d6bed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:07 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-202b9997-0633-4a03-bef0-70bab18ae3d0 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b" status: 200 len: 1697 microversion: 2.87 time: 0.542409 Apr 20 15:17:07 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 110/330] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:17:07 2023] GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b => generated 1697 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:17:08 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-62b79ebb-78c3-42cd-8249-51b32ea9b6ab req-222853ca-2480-4743-8d20-d7f3e7bb6e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4e175-7373-4a71-85b1-2b6b56ed2d2b", "name": "network-vif-deleted", "tag": "c24699b2-379d-421e-9cda-e7c230f9778d"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:17:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-62b79ebb-78c3-42cd-8249-51b32ea9b6ab req-222853ca-2480-4743-8d20-d7f3e7bb6e52 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-62b79ebb-78c3-42cd-8249-51b32ea9b6ab req-222853ca-2480-4743-8d20-d7f3e7bb6e52 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-62b79ebb-78c3-42cd-8249-51b32ea9b6ab req-222853ca-2480-4743-8d20-d7f3e7bb6e52 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:08 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-62b79ebb-78c3-42cd-8249-51b32ea9b6ab req-222853ca-2480-4743-8d20-d7f3e7bb6e52 service nova] Creating event network-vif-deleted:c24699b2-379d-421e-9cda-e7c230f9778d for instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b on user Apr 20 15:17:08 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-62b79ebb-78c3-42cd-8249-51b32ea9b6ab req-222853ca-2480-4743-8d20-d7f3e7bb6e52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029763 Apr 20 15:17:08 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 111/331] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:17:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:09 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:09 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-f278d082-886a-409e-9f3f-1ae03c42ba7b tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3" status: 200 len: 1588 microversion: 2.20 time: 0.242388 Apr 20 15:17:09 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 111/332] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:17:09 2023] GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 => generated 1588 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:17:09 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-ee281e57-5a98-417f-8f0b-dbcc516cbc4f req-1385e58f-fcd7-4f56-a047-b3b90d4bf9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4e175-7373-4a71-85b1-2b6b56ed2d2b", "name": "network-vif-plugged", "status": "completed", "tag": "c24699b2-379d-421e-9cda-e7c230f9778d"}, {"server_uuid": "36c4e175-7373-4a71-85b1-2b6b56ed2d2b", "name": "network-vif-plugged", "status": "completed", "tag": "c24699b2-379d-421e-9cda-e7c230f9778d"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:17:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ee281e57-5a98-417f-8f0b-dbcc516cbc4f req-1385e58f-fcd7-4f56-a047-b3b90d4bf9d1 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ee281e57-5a98-417f-8f0b-dbcc516cbc4f req-1385e58f-fcd7-4f56-a047-b3b90d4bf9d1 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ee281e57-5a98-417f-8f0b-dbcc516cbc4f req-1385e58f-fcd7-4f56-a047-b3b90d4bf9d1 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:09 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-ee281e57-5a98-417f-8f0b-dbcc516cbc4f req-1385e58f-fcd7-4f56-a047-b3b90d4bf9d1 service nova] Creating event network-vif-plugged:c24699b2-379d-421e-9cda-e7c230f9778d for instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b on user Apr 20 15:17:09 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-ee281e57-5a98-417f-8f0b-dbcc516cbc4f req-1385e58f-fcd7-4f56-a047-b3b90d4bf9d1 service nova] Creating event network-vif-plugged:c24699b2-379d-421e-9cda-e7c230f9778d for instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b on user Apr 20 15:17:09 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-ee281e57-5a98-417f-8f0b-dbcc516cbc4f req-1385e58f-fcd7-4f56-a047-b3b90d4bf9d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032560 Apr 20 15:17:09 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 111/333] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:17:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:17:23 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:23 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-00805cd1-fdc1-4aec-a2e8-835a45064b96 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:23 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-00805cd1-fdc1-4aec-a2e8-835a45064b96 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 66242fcd-cd65-442b-8643-b33fe81a8061] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-00805cd1-fdc1-4aec-a2e8-835a45064b96 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-00805cd1-fdc1-4aec-a2e8-835a45064b96 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-00805cd1-fdc1-4aec-a2e8-835a45064b96 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-00805cd1-fdc1-4aec-a2e8-835a45064b96 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-00805cd1-fdc1-4aec-a2e8-835a45064b96 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-00805cd1-fdc1-4aec-a2e8-835a45064b96 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:24 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-00805cd1-fdc1-4aec-a2e8-835a45064b96 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02e13ff5394016b693bfb61c0dd244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277c8babb24c43c6b386883035b7476c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:24 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-00805cd1-fdc1-4aec-a2e8-835a45064b96 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061" status: 200 len: 1489 microversion: 2.1 time: 0.220868 Apr 20 15:17:24 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:17:23 2023] GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061 => generated 1489 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:17:32 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-1a73bfcd-f273-43b1-973b-a119857ba16d tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:32 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-1a73bfcd-f273-43b1-973b-a119857ba16d tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] [instance: 71994663-7386-42fc-b512-59869acddfc0] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:32 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=12 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:32 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=20 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1a73bfcd-f273-43b1-973b-a119857ba16d tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1a73bfcd-f273-43b1-973b-a119857ba16d tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1a73bfcd-f273-43b1-973b-a119857ba16d tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1a73bfcd-f273-43b1-973b-a119857ba16d tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1a73bfcd-f273-43b1-973b-a119857ba16d tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:32 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-1a73bfcd-f273-43b1-973b-a119857ba16d tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:33 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-1a73bfcd-f273-43b1-973b-a119857ba16d tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2b076c0e354876981854fbadcc4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3b0b5be268475b92a96fcc1b02094e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:33 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-1a73bfcd-f273-43b1-973b-a119857ba16d tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0" status: 200 len: 1567 microversion: 2.1 time: 0.225352 Apr 20 15:17:33 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 112/335] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:17:32 2023] GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=12 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-af43a068-3b50-4c18-95c5-84b0ad82e9b0 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-af43a068-3b50-4c18-95c5-84b0ad82e9b0 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] [instance: 71994663-7386-42fc-b512-59869acddfc0] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-af43a068-3b50-4c18-95c5-84b0ad82e9b0 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-af43a068-3b50-4c18-95c5-84b0ad82e9b0 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-af43a068-3b50-4c18-95c5-84b0ad82e9b0 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-af43a068-3b50-4c18-95c5-84b0ad82e9b0 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-af43a068-3b50-4c18-95c5-84b0ad82e9b0 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-af43a068-3b50-4c18-95c5-84b0ad82e9b0 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:34 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-af43a068-3b50-4c18-95c5-84b0ad82e9b0 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] [instance: 71994663-7386-42fc-b512-59869acddfc0] Going to try to terminate instance {{(pid=61508) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:17:34 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-af43a068-3b50-4c18-95c5-84b0ad82e9b0 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0" status: 204 len: 0 microversion: 2.1 time: 0.129641 Apr 20 15:17:34 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 112/336] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:17:34 2023] DELETE /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:17:34 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f43f073e-802b-4f70-8572-313297ee6504 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:34 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f43f073e-802b-4f70-8572-313297ee6504 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] [instance: 71994663-7386-42fc-b512-59869acddfc0] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:34 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:34 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f43f073e-802b-4f70-8572-313297ee6504 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f43f073e-802b-4f70-8572-313297ee6504 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f43f073e-802b-4f70-8572-313297ee6504 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f43f073e-802b-4f70-8572-313297ee6504 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f43f073e-802b-4f70-8572-313297ee6504 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f43f073e-802b-4f70-8572-313297ee6504 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:35 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-f43f073e-802b-4f70-8572-313297ee6504 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2b076c0e354876981854fbadcc4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3b0b5be268475b92a96fcc1b02094e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f43f073e-802b-4f70-8572-313297ee6504 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0" status: 200 len: 1573 microversion: 2.1 time: 0.602011 Apr 20 15:17:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 113/337] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:17:34 2023] GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0 => generated 1573 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:17:35 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-d9c36f08-14c8-4f33-a003-a82d829ddde8 req-af46d75f-f95e-4537-8025-32b1a64c2592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71994663-7386-42fc-b512-59869acddfc0", "name": "network-vif-unplugged", "status": "completed", "tag": "161ee285-50e1-41c3-8dac-779bdabe34a3"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:17:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-d9c36f08-14c8-4f33-a003-a82d829ddde8 req-af46d75f-f95e-4537-8025-32b1a64c2592 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-d9c36f08-14c8-4f33-a003-a82d829ddde8 req-af46d75f-f95e-4537-8025-32b1a64c2592 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:35 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-d9c36f08-14c8-4f33-a003-a82d829ddde8 req-af46d75f-f95e-4537-8025-32b1a64c2592 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:35 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-d9c36f08-14c8-4f33-a003-a82d829ddde8 req-af46d75f-f95e-4537-8025-32b1a64c2592 service nova] Creating event network-vif-unplugged:161ee285-50e1-41c3-8dac-779bdabe34a3 for instance 71994663-7386-42fc-b512-59869acddfc0 on user Apr 20 15:17:35 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-d9c36f08-14c8-4f33-a003-a82d829ddde8 req-af46d75f-f95e-4537-8025-32b1a64c2592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033280 Apr 20 15:17:35 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 113/338] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:17:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:17:37 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-7e8babbc-0c56-4999-979e-d25b377a4754 req-20a60853-0715-4e57-84a1-39c304aabaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71994663-7386-42fc-b512-59869acddfc0", "name": "network-vif-plugged", "status": "completed", "tag": "161ee285-50e1-41c3-8dac-779bdabe34a3"}, {"server_uuid": "71994663-7386-42fc-b512-59869acddfc0", "name": "network-vif-plugged", "status": "completed", "tag": "161ee285-50e1-41c3-8dac-779bdabe34a3"}, {"server_uuid": "71994663-7386-42fc-b512-59869acddfc0", "name": "network-vif-plugged", "status": "completed", "tag": "161ee285-50e1-41c3-8dac-779bdabe34a3"}, {"server_uuid": "71994663-7386-42fc-b512-59869acddfc0", "name": "network-vif-deleted", "tag": "161ee285-50e1-41c3-8dac-779bdabe34a3"}, {"server_uuid": "71994663-7386-42fc-b512-59869acddfc0", "name": "network-vif-plugged", "status": "completed", "tag": "161ee285-50e1-41c3-8dac-779bdabe34a3"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:17:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-7e8babbc-0c56-4999-979e-d25b377a4754 req-20a60853-0715-4e57-84a1-39c304aabaf4 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-7e8babbc-0c56-4999-979e-d25b377a4754 req-20a60853-0715-4e57-84a1-39c304aabaf4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:37 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-7e8babbc-0c56-4999-979e-d25b377a4754 req-20a60853-0715-4e57-84a1-39c304aabaf4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-7e8babbc-0c56-4999-979e-d25b377a4754 req-20a60853-0715-4e57-84a1-39c304aabaf4 service nova] Creating event network-vif-plugged:161ee285-50e1-41c3-8dac-779bdabe34a3 for instance 71994663-7386-42fc-b512-59869acddfc0 on user Apr 20 15:17:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-7e8babbc-0c56-4999-979e-d25b377a4754 req-20a60853-0715-4e57-84a1-39c304aabaf4 service nova] Creating event network-vif-plugged:161ee285-50e1-41c3-8dac-779bdabe34a3 for instance 71994663-7386-42fc-b512-59869acddfc0 on user Apr 20 15:17:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-7e8babbc-0c56-4999-979e-d25b377a4754 req-20a60853-0715-4e57-84a1-39c304aabaf4 service nova] Creating event network-vif-plugged:161ee285-50e1-41c3-8dac-779bdabe34a3 for instance 71994663-7386-42fc-b512-59869acddfc0 on user Apr 20 15:17:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-7e8babbc-0c56-4999-979e-d25b377a4754 req-20a60853-0715-4e57-84a1-39c304aabaf4 service nova] Creating event network-vif-deleted:161ee285-50e1-41c3-8dac-779bdabe34a3 for instance 71994663-7386-42fc-b512-59869acddfc0 on user Apr 20 15:17:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-7e8babbc-0c56-4999-979e-d25b377a4754 req-20a60853-0715-4e57-84a1-39c304aabaf4 service nova] Creating event network-vif-plugged:161ee285-50e1-41c3-8dac-779bdabe34a3 for instance 71994663-7386-42fc-b512-59869acddfc0 on user Apr 20 15:17:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-7e8babbc-0c56-4999-979e-d25b377a4754 req-20a60853-0715-4e57-84a1-39c304aabaf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.033270 Apr 20 15:17:37 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 113/339] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:17:37 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:17:38 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-8a681203-9f2b-4259-a3f2-3a3d3a682945 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:38 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-8a681203-9f2b-4259-a3f2-3a3d3a682945 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8a681203-9f2b-4259-a3f2-3a3d3a682945 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8a681203-9f2b-4259-a3f2-3a3d3a682945 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8a681203-9f2b-4259-a3f2-3a3d3a682945 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8a681203-9f2b-4259-a3f2-3a3d3a682945 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8a681203-9f2b-4259-a3f2-3a3d3a682945 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8a681203-9f2b-4259-a3f2-3a3d3a682945 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:38 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-8a681203-9f2b-4259-a3f2-3a3d3a682945 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:17:38 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-8a681203-9f2b-4259-a3f2-3a3d3a682945 tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 204 len: 0 microversion: 2.1 time: 0.110927 Apr 20 15:17:38 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 114/340] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:17:38 2023] DELETE /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:17:38 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-0f649469-82ba-4272-8d0b-7ac575a7162c tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:38 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-0f649469-82ba-4272-8d0b-7ac575a7162c tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0f649469-82ba-4272-8d0b-7ac575a7162c tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0f649469-82ba-4272-8d0b-7ac575a7162c tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0f649469-82ba-4272-8d0b-7ac575a7162c tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0f649469-82ba-4272-8d0b-7ac575a7162c tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0f649469-82ba-4272-8d0b-7ac575a7162c tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:38 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-0f649469-82ba-4272-8d0b-7ac575a7162c tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:38 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-d955e110-55d7-4a75-b7e6-8b19a7e779df req-925586c4-8576-4150-8d2d-73ac9e23802e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb81fa0-7c0d-4144-bce4-fc9053c94e8e", "name": "network-vif-unplugged", "status": "completed", "tag": "893ef125-a4b8-4206-8d2f-d01891c151b8"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:17:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-d955e110-55d7-4a75-b7e6-8b19a7e779df req-925586c4-8576-4150-8d2d-73ac9e23802e service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-d955e110-55d7-4a75-b7e6-8b19a7e779df req-925586c4-8576-4150-8d2d-73ac9e23802e service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-d955e110-55d7-4a75-b7e6-8b19a7e779df req-925586c4-8576-4150-8d2d-73ac9e23802e service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:38 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-d955e110-55d7-4a75-b7e6-8b19a7e779df req-925586c4-8576-4150-8d2d-73ac9e23802e service nova] Creating event network-vif-unplugged:893ef125-a4b8-4206-8d2f-d01891c151b8 for instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e on user Apr 20 15:17:38 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-d955e110-55d7-4a75-b7e6-8b19a7e779df req-925586c4-8576-4150-8d2d-73ac9e23802e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029985 Apr 20 15:17:38 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-0f649469-82ba-4272-8d0b-7ac575a7162c tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc3e810ea474fa06a22c17c5f0bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606d9ee60abb40628f7e7d63e0275d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:17:38 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 114/341] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:17:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:17:38 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-0f649469-82ba-4272-8d0b-7ac575a7162c tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 200 len: 1664 microversion: 2.1 time: 0.251049 Apr 20 15:17:38 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 114/342] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:17:38 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 1664 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:17:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-18521138-3fce-46bf-9aed-71526b76c657 req-88b059cf-6cf3-41df-95fb-9c8d8dfe7966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb81fa0-7c0d-4144-bce4-fc9053c94e8e", "name": "network-vif-deleted", "tag": "893ef125-a4b8-4206-8d2f-d01891c151b8"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:17:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-18521138-3fce-46bf-9aed-71526b76c657 req-88b059cf-6cf3-41df-95fb-9c8d8dfe7966 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-18521138-3fce-46bf-9aed-71526b76c657 req-88b059cf-6cf3-41df-95fb-9c8d8dfe7966 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-18521138-3fce-46bf-9aed-71526b76c657 req-88b059cf-6cf3-41df-95fb-9c8d8dfe7966 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-18521138-3fce-46bf-9aed-71526b76c657 req-88b059cf-6cf3-41df-95fb-9c8d8dfe7966 service nova] Creating event network-vif-deleted:893ef125-a4b8-4206-8d2f-d01891c151b8 for instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e on user Apr 20 15:17:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-18521138-3fce-46bf-9aed-71526b76c657 req-88b059cf-6cf3-41df-95fb-9c8d8dfe7966 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029624 Apr 20 15:17:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 115/343] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:17:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:17:40 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-ac3586a1-81ff-4e1d-ac26-7046efec1841 req-5343a6e3-9fb2-4128-8011-c1926fc90dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb81fa0-7c0d-4144-bce4-fc9053c94e8e", "name": "network-vif-plugged", "status": "completed", "tag": "893ef125-a4b8-4206-8d2f-d01891c151b8"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:17:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ac3586a1-81ff-4e1d-ac26-7046efec1841 req-5343a6e3-9fb2-4128-8011-c1926fc90dff service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ac3586a1-81ff-4e1d-ac26-7046efec1841 req-5343a6e3-9fb2-4128-8011-c1926fc90dff service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-ac3586a1-81ff-4e1d-ac26-7046efec1841 req-5343a6e3-9fb2-4128-8011-c1926fc90dff service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:40 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-ac3586a1-81ff-4e1d-ac26-7046efec1841 req-5343a6e3-9fb2-4128-8011-c1926fc90dff service nova] Creating event network-vif-plugged:893ef125-a4b8-4206-8d2f-d01891c151b8 for instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e on user Apr 20 15:17:40 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-ac3586a1-81ff-4e1d-ac26-7046efec1841 req-5343a6e3-9fb2-4128-8011-c1926fc90dff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030449 Apr 20 15:17:40 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 115/344] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:17:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] [instance: 36c4e175-7373-4a71-85b1-2b6b56ed2d2b] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=14 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:17:57 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] HTTP exception thrown: Instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b could not be found. Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Request method failure captured: Apr 20 15:17:57 user devstack@n-api.service[61509]: request: GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b HTTP/1.1 Apr 20 15:17:57 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:17:57 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:17:57 user devstack@n-api.service[61509]: Connection: close Apr 20 15:17:57 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:17:57 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:17:57 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:17:57 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:17:57 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVVxifQhLh6haZF7OFMEa88rkO6musJzeutvw2tGr_aikmEOjg3pT-FNBOBwV498YHXxBJNjACcf12tEqz13zia3YO4cAGgfSGjJy_X1uYy36PSb-JYgh5guqGDK74Mv9iFGBgvQBtW5DMlIiMoqOYP6W54wS58GKKB1FquD3E95S_E Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Project-Id: b53c73dfc9094d05802c05b2f25d6bed Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53c73dfc9094d05802c05b2f25d6bed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53c73dfc9094d05802c05b2f25d6bed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b53c73dfc9094d05802c05b2f25d6bed"}]}] Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Tenant-Id: b53c73dfc9094d05802c05b2f25d6bed Apr 20 15:17:57 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598 Apr 20 15:17:57 user devstack@n-api.service[61509]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member Apr 20 15:17:57 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:17:57 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:17:57 user devstack@n-api.service[61509]: X-User-Id: f19d8fcc1b69479992ff0d8bc5c99306 Apr 20 15:17:57 user devstack@n-api.service[61509]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member Apr 20 15:17:57 user devstack@n-api.service[61509]: method: > Apr 20 15:17:57 user devstack@n-api.service[61509]: exception: Instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b could not be found. Apr 20 15:17:57 user devstack@n-api.service[61509]: action_args: {'id': '36c4e175-7373-4a71-85b1-2b6b56ed2d2b'} Apr 20 15:17:57 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b could not be found. Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b could not be found. Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b could not be found. Apr 20 15:17:57 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:17:57 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] Returning 404 to user: Instance 36c4e175-7373-4a71-85b1-2b6b56ed2d2b could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:17:57 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-b487b57a-5346-48bd-be91-6eb0bfe951d5 tempest-ServerBootFromVolumeStableRescueTest-1660715598 tempest-ServerBootFromVolumeStableRescueTest-1660715598-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b" status: 404 len: 111 microversion: 2.87 time: 0.038099 Apr 20 15:17:57 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 115/345] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:17:57 2023] GET /compute/v2.1/servers/36c4e175-7373-4a71-85b1-2b6b56ed2d2b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: c62c36e6-6410-4f7d-9968-e0e7bded79fc] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] HTTP exception thrown: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Request method failure captured: Apr 20 15:18:03 user devstack@n-api.service[61510]: request: DELETE /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc HTTP/1.1 Apr 20 15:18:03 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:18:03 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:18:03 user devstack@n-api.service[61510]: Connection: close Apr 20 15:18:03 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:18:03 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:18:03 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:18:03 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:18:03 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVWkyBXvY6UZjnCugjjyakm7BAN9il6WMWd6FzgczquyuN_v0937tzd-RY3meTHvgtCizgGF1Lo1bYjYhgO3j3liR5TRa4-o-jSRjQhPKIte1OmbW-QQ1Igl6agKdh82fRexT_-0RTtOiTim7SCWe59Q3nbG2CPPrbIYtT74ucT9wEE Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Project-Id: 061d2444339049d0a0bb680f55ce75e3 Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Project-Name: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/061d2444339049d0a0bb680f55ce75e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/061d2444339049d0a0bb680f55ce75e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/061d2444339049d0a0bb680f55ce75e3"}]}] Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Tenant: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Tenant-Id: 061d2444339049d0a0bb680f55ce75e3 Apr 20 15:18:03 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:18:03 user devstack@n-api.service[61510]: X-User: tempest-ServersNegativeTestJSON-1460486547-project-member Apr 20 15:18:03 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:18:03 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:18:03 user devstack@n-api.service[61510]: X-User-Id: 515a83630b834f03a4fd748fb75b3550 Apr 20 15:18:03 user devstack@n-api.service[61510]: X-User-Name: tempest-ServersNegativeTestJSON-1460486547-project-member Apr 20 15:18:03 user devstack@n-api.service[61510]: method: > Apr 20 15:18:03 user devstack@n-api.service[61510]: exception: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:18:03 user devstack@n-api.service[61510]: action_args: {'id': 'c62c36e6-6410-4f7d-9968-e0e7bded79fc'} Apr 20 15:18:03 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:18:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Returning 404 to user: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:18:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b5fd63ea-e368-4417-996f-23306dd00ca6 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc" status: 404 len: 111 microversion: 2.1 time: 0.044242 Apr 20 15:18:03 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 116/346] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:18:03 2023] DELETE /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: c62c36e6-6410-4f7d-9968-e0e7bded79fc] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:03 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] HTTP exception thrown: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Request method failure captured: Apr 20 15:18:03 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc HTTP/1.1 Apr 20 15:18:03 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:18:03 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:18:03 user devstack@n-api.service[61508]: Connection: close Apr 20 15:18:03 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:18:03 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:18:03 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:18:03 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:18:03 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVWkyBXvY6UZjnCugjjyakm7BAN9il6WMWd6FzgczquyuN_v0937tzd-RY3meTHvgtCizgGF1Lo1bYjYhgO3j3liR5TRa4-o-jSRjQhPKIte1OmbW-QQ1Igl6agKdh82fRexT_-0RTtOiTim7SCWe59Q3nbG2CPPrbIYtT74ucT9wEE Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Project-Id: 061d2444339049d0a0bb680f55ce75e3 Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Project-Name: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/061d2444339049d0a0bb680f55ce75e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/061d2444339049d0a0bb680f55ce75e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/061d2444339049d0a0bb680f55ce75e3"}]}] Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Tenant: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Tenant-Id: 061d2444339049d0a0bb680f55ce75e3 Apr 20 15:18:03 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:18:03 user devstack@n-api.service[61508]: X-User: tempest-ServersNegativeTestJSON-1460486547-project-member Apr 20 15:18:03 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:18:03 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:18:03 user devstack@n-api.service[61508]: X-User-Id: 515a83630b834f03a4fd748fb75b3550 Apr 20 15:18:03 user devstack@n-api.service[61508]: X-User-Name: tempest-ServersNegativeTestJSON-1460486547-project-member Apr 20 15:18:03 user devstack@n-api.service[61508]: method: > Apr 20 15:18:03 user devstack@n-api.service[61508]: exception: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:18:03 user devstack@n-api.service[61508]: action_args: {'id': 'c62c36e6-6410-4f7d-9968-e0e7bded79fc'} Apr 20 15:18:03 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. Apr 20 15:18:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:03 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Returning 404 to user: Instance c62c36e6-6410-4f7d-9968-e0e7bded79fc could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:18:03 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-1b66e430-69d1-4027-b52f-ce78edf1f3ba tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc" status: 404 len: 111 microversion: 2.1 time: 0.042579 Apr 20 15:18:03 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 116/347] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:18:03 2023] GET /compute/v2.1/servers/c62c36e6-6410-4f7d-9968-e0e7bded79fc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:18:03 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-2350b806-bcd7-4985-bec2-b65f32fa08fd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:03 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-2350b806-bcd7-4985-bec2-b65f32fa08fd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2350b806-bcd7-4985-bec2-b65f32fa08fd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2350b806-bcd7-4985-bec2-b65f32fa08fd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2350b806-bcd7-4985-bec2-b65f32fa08fd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2350b806-bcd7-4985-bec2-b65f32fa08fd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2350b806-bcd7-4985-bec2-b65f32fa08fd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2350b806-bcd7-4985-bec2-b65f32fa08fd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:03 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-2350b806-bcd7-4985-bec2-b65f32fa08fd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] Going to try to terminate instance {{(pid=61509) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:18:03 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-2350b806-bcd7-4985-bec2-b65f32fa08fd tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82" status: 204 len: 0 microversion: 2.1 time: 0.114529 Apr 20 15:18:03 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 116/348] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:18:03 2023] DELETE /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c16cbffb-b60f-453a-a152-b541009fe45a tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c16cbffb-b60f-453a-a152-b541009fe45a tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c16cbffb-b60f-453a-a152-b541009fe45a tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c16cbffb-b60f-453a-a152-b541009fe45a tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c16cbffb-b60f-453a-a152-b541009fe45a tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c16cbffb-b60f-453a-a152-b541009fe45a tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c16cbffb-b60f-453a-a152-b541009fe45a tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c16cbffb-b60f-453a-a152-b541009fe45a tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:04 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-b74db1fe-e948-482b-bce1-b38808f0e20b req-2004b2bf-1ebe-4a47-ad0d-2546b6c2fd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82", "name": "network-vif-unplugged", "status": "completed", "tag": "58eedb9f-ab35-43ae-8c5f-8d95967f0756"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:18:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-b74db1fe-e948-482b-bce1-b38808f0e20b req-2004b2bf-1ebe-4a47-ad0d-2546b6c2fd77 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-b74db1fe-e948-482b-bce1-b38808f0e20b req-2004b2bf-1ebe-4a47-ad0d-2546b6c2fd77 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:04 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-b74db1fe-e948-482b-bce1-b38808f0e20b req-2004b2bf-1ebe-4a47-ad0d-2546b6c2fd77 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:04 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-b74db1fe-e948-482b-bce1-b38808f0e20b req-2004b2bf-1ebe-4a47-ad0d-2546b6c2fd77 service nova] Creating event network-vif-unplugged:58eedb9f-ab35-43ae-8c5f-8d95967f0756 for instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 on user Apr 20 15:18:04 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-b74db1fe-e948-482b-bce1-b38808f0e20b req-2004b2bf-1ebe-4a47-ad0d-2546b6c2fd77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031018 Apr 20 15:18:04 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 117/349] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:18:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:18:04 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-c16cbffb-b60f-453a-a152-b541009fe45a tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515a83630b834f03a4fd748fb75b3550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d2444339049d0a0bb680f55ce75e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:18:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c16cbffb-b60f-453a-a152-b541009fe45a tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82" status: 200 len: 1500 microversion: 2.1 time: 0.375470 Apr 20 15:18:04 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 117/350] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:18:03 2023] GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 => generated 1500 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:18:06 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-9e0c1861-990b-4e88-9e7a-b2ba5d4515e3 req-1ddebf3b-7cf1-4a14-98c5-5282f4e7254a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82", "name": "network-vif-plugged", "status": "completed", "tag": "58eedb9f-ab35-43ae-8c5f-8d95967f0756"}, {"server_uuid": "5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82", "name": "network-vif-deleted", "tag": "58eedb9f-ab35-43ae-8c5f-8d95967f0756"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:18:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-9e0c1861-990b-4e88-9e7a-b2ba5d4515e3 req-1ddebf3b-7cf1-4a14-98c5-5282f4e7254a service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-9e0c1861-990b-4e88-9e7a-b2ba5d4515e3 req-1ddebf3b-7cf1-4a14-98c5-5282f4e7254a service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:06 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-9e0c1861-990b-4e88-9e7a-b2ba5d4515e3 req-1ddebf3b-7cf1-4a14-98c5-5282f4e7254a service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:06 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-9e0c1861-990b-4e88-9e7a-b2ba5d4515e3 req-1ddebf3b-7cf1-4a14-98c5-5282f4e7254a service nova] Creating event network-vif-plugged:58eedb9f-ab35-43ae-8c5f-8d95967f0756 for instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 on user Apr 20 15:18:06 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-9e0c1861-990b-4e88-9e7a-b2ba5d4515e3 req-1ddebf3b-7cf1-4a14-98c5-5282f4e7254a service nova] Creating event network-vif-deleted:58eedb9f-ab35-43ae-8c5f-8d95967f0756 for instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 on user Apr 20 15:18:06 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-9e0c1861-990b-4e88-9e7a-b2ba5d4515e3 req-1ddebf3b-7cf1-4a14-98c5-5282f4e7254a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036648 Apr 20 15:18:06 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 117/351] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:18:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:18:09 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-f7ed5dcf-9d07-45e1-8c82-e4f74729a82f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:09 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-f7ed5dcf-9d07-45e1-8c82-e4f74729a82f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f7ed5dcf-9d07-45e1-8c82-e4f74729a82f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f7ed5dcf-9d07-45e1-8c82-e4f74729a82f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f7ed5dcf-9d07-45e1-8c82-e4f74729a82f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f7ed5dcf-9d07-45e1-8c82-e4f74729a82f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f7ed5dcf-9d07-45e1-8c82-e4f74729a82f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-f7ed5dcf-9d07-45e1-8c82-e4f74729a82f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:09 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-f7ed5dcf-9d07-45e1-8c82-e4f74729a82f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.210649 Apr 20 15:18:09 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 118/352] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 15:18:09 2023] GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3/os-interface => generated 283 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:18:10 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-d8ad8e1c-8d70-408d-bd9a-ed2db59a2404 req-76502656-1711-4644-bd69-2497baa32b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff56ab94-63cf-4527-a46f-aa0a2adfcdc3", "tag": "791f0522-477d-4e2a-baed-c3d02080a144"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:18:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d8ad8e1c-8d70-408d-bd9a-ed2db59a2404 req-76502656-1711-4644-bd69-2497baa32b59 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d8ad8e1c-8d70-408d-bd9a-ed2db59a2404 req-76502656-1711-4644-bd69-2497baa32b59 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d8ad8e1c-8d70-408d-bd9a-ed2db59a2404 req-76502656-1711-4644-bd69-2497baa32b59 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-d8ad8e1c-8d70-408d-bd9a-ed2db59a2404 req-76502656-1711-4644-bd69-2497baa32b59 service nova] Creating event network-changed:791f0522-477d-4e2a-baed-c3d02080a144 for instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 on user Apr 20 15:18:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-d8ad8e1c-8d70-408d-bd9a-ed2db59a2404 req-76502656-1711-4644-bd69-2497baa32b59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029699 Apr 20 15:18:10 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 118/353] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:18:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:18:10 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-9c06f9b5-87f6-46aa-a858-650bfa807a41 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:10 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-9c06f9b5-87f6-46aa-a858-650bfa807a41 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9c06f9b5-87f6-46aa-a858-650bfa807a41 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9c06f9b5-87f6-46aa-a858-650bfa807a41 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9c06f9b5-87f6-46aa-a858-650bfa807a41 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9c06f9b5-87f6-46aa-a858-650bfa807a41 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9c06f9b5-87f6-46aa-a858-650bfa807a41 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:10 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-9c06f9b5-87f6-46aa-a858-650bfa807a41 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:10 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-9c06f9b5-87f6-46aa-a858-650bfa807a41 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3/ips" status: 200 len: 111 microversion: 2.20 time: 0.041683 Apr 20 15:18:10 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 118/354] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 15:18:10 2023] GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3/ips => generated 111 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:18:12 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-114e1cad-4d1f-495a-866c-d376d00039bb tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:12 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-114e1cad-4d1f-495a-866c-d376d00039bb tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-114e1cad-4d1f-495a-866c-d376d00039bb tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-114e1cad-4d1f-495a-866c-d376d00039bb tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-114e1cad-4d1f-495a-866c-d376d00039bb tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-114e1cad-4d1f-495a-866c-d376d00039bb tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-114e1cad-4d1f-495a-866c-d376d00039bb tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:12 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-114e1cad-4d1f-495a-866c-d376d00039bb tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:12 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-114e1cad-4d1f-495a-866c-d376d00039bb tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] Going to try to terminate instance {{(pid=61508) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:18:12 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-114e1cad-4d1f-495a-866c-d376d00039bb tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3" status: 204 len: 0 microversion: 2.20 time: 0.106565 Apr 20 15:18:12 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 119/355] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 15:18:11 2023] DELETE /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:18:12 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbd3a1bdaa3d4259a7f578e485a929ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfe062836ab4f98866f6058a0a50f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:18:12 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-e9a7a241-1399-46ba-84f8-5ed20516e7fa tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3" status: 200 len: 1713 microversion: 2.20 time: 0.244204 Apr 20 15:18:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-b92f8018-a787-4a4c-94ed-b2aeee34fcb6 req-481f726d-9d0d-4c59-b9ea-c82517f73834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff56ab94-63cf-4527-a46f-aa0a2adfcdc3", "name": "network-vif-unplugged", "status": "completed", "tag": "791f0522-477d-4e2a-baed-c3d02080a144"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:18:12 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 119/356] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:18:12 2023] GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 => generated 1713 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:18:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-b92f8018-a787-4a4c-94ed-b2aeee34fcb6 req-481f726d-9d0d-4c59-b9ea-c82517f73834 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-b92f8018-a787-4a4c-94ed-b2aeee34fcb6 req-481f726d-9d0d-4c59-b9ea-c82517f73834 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-b92f8018-a787-4a4c-94ed-b2aeee34fcb6 req-481f726d-9d0d-4c59-b9ea-c82517f73834 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:12 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-b92f8018-a787-4a4c-94ed-b2aeee34fcb6 req-481f726d-9d0d-4c59-b9ea-c82517f73834 service nova] Creating event network-vif-unplugged:791f0522-477d-4e2a-baed-c3d02080a144 for instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 on user Apr 20 15:18:12 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-b92f8018-a787-4a4c-94ed-b2aeee34fcb6 req-481f726d-9d0d-4c59-b9ea-c82517f73834 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034492 Apr 20 15:18:12 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 119/357] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:18:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:18:13 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-a8bf4b4d-29f7-4c93-a617-4bf91b9cbb50 req-81366bd5-f211-4945-8aa6-f5d3e7946959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff56ab94-63cf-4527-a46f-aa0a2adfcdc3", "name": "network-vif-deleted", "tag": "791f0522-477d-4e2a-baed-c3d02080a144"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:18:13 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-a8bf4b4d-29f7-4c93-a617-4bf91b9cbb50 req-81366bd5-f211-4945-8aa6-f5d3e7946959 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:13 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-a8bf4b4d-29f7-4c93-a617-4bf91b9cbb50 req-81366bd5-f211-4945-8aa6-f5d3e7946959 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:13 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-a8bf4b4d-29f7-4c93-a617-4bf91b9cbb50 req-81366bd5-f211-4945-8aa6-f5d3e7946959 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:13 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-a8bf4b4d-29f7-4c93-a617-4bf91b9cbb50 req-81366bd5-f211-4945-8aa6-f5d3e7946959 service nova] Creating event network-vif-deleted:791f0522-477d-4e2a-baed-c3d02080a144 for instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 on user Apr 20 15:18:13 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-a8bf4b4d-29f7-4c93-a617-4bf91b9cbb50 req-81366bd5-f211-4945-8aa6-f5d3e7946959 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029079 Apr 20 15:18:13 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 120/358] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:18:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:18:14 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-445d98a5-57c3-417d-9915-4e5d70b0ee60 req-d12ac13b-1a4f-4aa9-94cf-690e5315df52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff56ab94-63cf-4527-a46f-aa0a2adfcdc3", "name": "network-vif-plugged", "status": "completed", "tag": "791f0522-477d-4e2a-baed-c3d02080a144"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:18:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-445d98a5-57c3-417d-9915-4e5d70b0ee60 req-d12ac13b-1a4f-4aa9-94cf-690e5315df52 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-445d98a5-57c3-417d-9915-4e5d70b0ee60 req-d12ac13b-1a4f-4aa9-94cf-690e5315df52 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-445d98a5-57c3-417d-9915-4e5d70b0ee60 req-d12ac13b-1a4f-4aa9-94cf-690e5315df52 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-445d98a5-57c3-417d-9915-4e5d70b0ee60 req-d12ac13b-1a4f-4aa9-94cf-690e5315df52 service nova] Creating event network-vif-plugged:791f0522-477d-4e2a-baed-c3d02080a144 for instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 on user Apr 20 15:18:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-445d98a5-57c3-417d-9915-4e5d70b0ee60 req-d12ac13b-1a4f-4aa9-94cf-690e5315df52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027989 Apr 20 15:18:14 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 120/359] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:18:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-8b1820d7-1b64-484a-8433-57f47a4251b5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-8b1820d7-1b64-484a-8433-57f47a4251b5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 32f44a87-50b3-449f-83dc-a7102cf727c5] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8b1820d7-1b64-484a-8433-57f47a4251b5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8b1820d7-1b64-484a-8433-57f47a4251b5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8b1820d7-1b64-484a-8433-57f47a4251b5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8b1820d7-1b64-484a-8433-57f47a4251b5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8b1820d7-1b64-484a-8433-57f47a4251b5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8b1820d7-1b64-484a-8433-57f47a4251b5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:24 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-8b1820d7-1b64-484a-8433-57f47a4251b5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02e13ff5394016b693bfb61c0dd244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277c8babb24c43c6b386883035b7476c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:18:24 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-8b1820d7-1b64-484a-8433-57f47a4251b5 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5" status: 200 len: 1503 microversion: 2.1 time: 0.224576 Apr 20 15:18:24 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 120/360] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:18:24 2023] GET /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] [instance: 71994663-7386-42fc-b512-59869acddfc0] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:25 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] HTTP exception thrown: Instance 71994663-7386-42fc-b512-59869acddfc0 could not be found. Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Request method failure captured: Apr 20 15:18:25 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0 HTTP/1.1 Apr 20 15:18:25 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:18:25 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:18:25 user devstack@n-api.service[61508]: Connection: close Apr 20 15:18:25 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:18:25 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:18:25 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:18:25 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:18:25 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVcVFYQ9HL4wCS8XqDxijjd1awsurHHHFIFsJE71GmAGYaB9KUt4ZwMBfOilzp9fq6x2BKQcYADLrOT_JgBQWg9i8UBdNmkf_ABie_Egi6khZW7Od-0UDrkimndJjcNx-JzciIg4xPh-3wb9_FWCKM18ZJR0xSSnu3B0llPLPYVxf-k Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Project-Id: 5b3b0b5be268475b92a96fcc1b02094e Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1949893148 Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b3b0b5be268475b92a96fcc1b02094e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b3b0b5be268475b92a96fcc1b02094e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b3b0b5be268475b92a96fcc1b02094e"}]}] Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Tenant: tempest-SnapshotDataIntegrityTests-1949893148 Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Tenant-Id: 5b3b0b5be268475b92a96fcc1b02094e Apr 20 15:18:25 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1949893148 Apr 20 15:18:25 user devstack@n-api.service[61508]: X-User: tempest-SnapshotDataIntegrityTests-1949893148-project-member Apr 20 15:18:25 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:18:25 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:18:25 user devstack@n-api.service[61508]: X-User-Id: 1b2b076c0e354876981854fbadcc4696 Apr 20 15:18:25 user devstack@n-api.service[61508]: X-User-Name: tempest-SnapshotDataIntegrityTests-1949893148-project-member Apr 20 15:18:25 user devstack@n-api.service[61508]: method: > Apr 20 15:18:25 user devstack@n-api.service[61508]: exception: Instance 71994663-7386-42fc-b512-59869acddfc0 could not be found. Apr 20 15:18:25 user devstack@n-api.service[61508]: action_args: {'id': '71994663-7386-42fc-b512-59869acddfc0'} Apr 20 15:18:25 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71994663-7386-42fc-b512-59869acddfc0 could not be found. Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71994663-7386-42fc-b512-59869acddfc0 could not be found. Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71994663-7386-42fc-b512-59869acddfc0 could not be found. Apr 20 15:18:25 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:25 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Returning 404 to user: Instance 71994663-7386-42fc-b512-59869acddfc0 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:18:25 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-7377f597-8a00-49ae-98c9-f600d9e5ba0f tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0" status: 404 len: 111 microversion: 2.1 time: 0.036780 Apr 20 15:18:25 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:18:25 2023] GET /compute/v2.1/servers/71994663-7386-42fc-b512-59869acddfc0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:18:25 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=10 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:25 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=18 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:25 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-50c4d305-90d3-487f-803f-ec7701ed4f40 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] Calling method '.version_select at 0x7fcbb3605ea0>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-50c4d305-90d3-487f-803f-ec7701ed4f40 tempest-SnapshotDataIntegrityTests-1949893148 tempest-SnapshotDataIntegrityTests-1949893148-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1842611209" status: 202 len: 0 microversion: 2.1 time: 0.028710 Apr 20 15:18:25 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 121/362] 10.0.0.210 () {62 vars in 1355 bytes} [Thu Apr 20 15:18:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1842611209 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:18:28 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:28 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] [instance: 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:28 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:28 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:28 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:28 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:28 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:28 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:28 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] HTTP exception thrown: Instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e could not be found. Apr 20 15:18:28 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Request method failure captured: Apr 20 15:18:28 user devstack@n-api.service[61509]: request: GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e HTTP/1.1 Apr 20 15:18:28 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:18:28 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:18:28 user devstack@n-api.service[61509]: Connection: close Apr 20 15:18:28 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:18:28 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:18:28 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:18:28 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:18:28 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVVyLGogxgGNgxvNElv3g_KzrPiKy_D-stUyWOlB1R-VI442xoxoX-g9gaVaki8jXcXZfui1ptuNjlApZx_IYwzl7_wgLzA8AdvGR1P3njN9pL-i6SiwQIeAVCbfxPRyhcSFBYJ6EGjD0jR-pUmrADjKhTRiQAkxfEffMaY3aa6gkno Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Project-Id: 606d9ee60abb40628f7e7d63e0275d63 Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Project-Name: tempest-ServerActionsTestJSON-1255937010 Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/606d9ee60abb40628f7e7d63e0275d63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/606d9ee60abb40628f7e7d63e0275d63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/606d9ee60abb40628f7e7d63e0275d63"}]}] Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Tenant: tempest-ServerActionsTestJSON-1255937010 Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Tenant-Id: 606d9ee60abb40628f7e7d63e0275d63 Apr 20 15:18:28 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-ServerActionsTestJSON-1255937010 Apr 20 15:18:28 user devstack@n-api.service[61509]: X-User: tempest-ServerActionsTestJSON-1255937010-project-member Apr 20 15:18:28 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:18:28 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:18:28 user devstack@n-api.service[61509]: X-User-Id: 877cc3e810ea474fa06a22c17c5f0bd4 Apr 20 15:18:28 user devstack@n-api.service[61509]: X-User-Name: tempest-ServerActionsTestJSON-1255937010-project-member Apr 20 15:18:28 user devstack@n-api.service[61509]: method: > Apr 20 15:18:28 user devstack@n-api.service[61509]: exception: Instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e could not be found. Apr 20 15:18:28 user devstack@n-api.service[61509]: action_args: {'id': '8bb81fa0-7c0d-4144-bce4-fc9053c94e8e'} Apr 20 15:18:28 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e could not be found. Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e could not be found. Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e could not be found. Apr 20 15:18:28 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:28 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Returning 404 to user: Instance 8bb81fa0-7c0d-4144-bce4-fc9053c94e8e could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:18:28 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-4fc264c6-839b-46db-a058-6f7a0ad8409a tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e" status: 404 len: 111 microversion: 2.1 time: 0.034590 Apr 20 15:18:28 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 121/363] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:18:28 2023] GET /compute/v2.1/servers/8bb81fa0-7c0d-4144-bce4-fc9053c94e8e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:18:28 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-5fc95768-530d-445d-8bcb-a863e185c33e tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] Calling method '.version_select at 0x7fcbb37a7490>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:29 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-5fc95768-530d-445d-8bcb-a863e185c33e tempest-ServerActionsTestJSON-1255937010 tempest-ServerActionsTestJSON-1255937010-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226107213" status: 202 len: 0 microversion: 2.1 time: 0.219708 Apr 20 15:18:29 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 122/364] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 15:18:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226107213 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:18:34 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-30507bd5-a662-4ed4-bff3-4dd6ec672b68 tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] Action: 'create', calling method: .version_select at 0x7fcbb369ed40>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-228419116"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:18:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-30507bd5-a662-4ed4-bff3-4dd6ec672b68 tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.781766 Apr 20 15:18:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 122/365] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 20 15:18:34 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 783 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 15:18:35 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-4853a5dc-7484-4b69-b4ee-cc01f195506c tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] Calling method '.version_select at 0x7fcbb38f57e0>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:35 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-4853a5dc-7484-4b69-b4ee-cc01f195506c tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5cbd4a55-33ee-4634-b569-22fd82fa247a" status: 200 len: 341 microversion: 2.1 time: 0.059426 Apr 20 15:18:35 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 122/366] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 15:18:35 2023] GET /compute/v2.1/os-volumes/5cbd4a55-33ee-4634-b569-22fd82fa247a => generated 341 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:18:36 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:36 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-b30d22be-6aa7-41c9-affc-b16f40528cd6 tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] Calling method '.version_select at 0x7fcbb36117e0>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:36 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-b30d22be-6aa7-41c9-affc-b16f40528cd6 tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5cbd4a55-33ee-4634-b569-22fd82fa247a" status: 200 len: 341 microversion: 2.1 time: 0.112290 Apr 20 15:18:36 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 123/367] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 15:18:36 2023] GET /compute/v2.1/os-volumes/5cbd4a55-33ee-4634-b569-22fd82fa247a => generated 341 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:18:36 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:36 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-983dc092-2629-4400-8f58-4d8f6496124a tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] Calling method '.version_select at 0x7fcbb426b2e0>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:36 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-983dc092-2629-4400-8f58-4d8f6496124a tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/5cbd4a55-33ee-4634-b569-22fd82fa247a" status: 202 len: 0 microversion: 2.1 time: 0.110919 Apr 20 15:18:36 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 123/368] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 15:18:36 2023] DELETE /compute/v2.1/os-volumes/5cbd4a55-33ee-4634-b569-22fd82fa247a => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:18:36 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-96ca41bd-f0c3-4c20-9261-2f856a0702c3 tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] Calling method '.version_select at 0x7fcbb38f7b50>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:36 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-96ca41bd-f0c3-4c20-9261-2f856a0702c3 tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] HTTP exception thrown: Volume 5cbd4a55-33ee-4634-b569-22fd82fa247a could not be found. Apr 20 15:18:36 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-96ca41bd-f0c3-4c20-9261-2f856a0702c3 tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] Request method failure captured: Apr 20 15:18:36 user devstack@n-api.service[61509]: request: GET /compute/v2.1/os-volumes/5cbd4a55-33ee-4634-b569-22fd82fa247a HTTP/1.1 Apr 20 15:18:36 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:18:36 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:18:36 user devstack@n-api.service[61509]: Connection: close Apr 20 15:18:36 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:18:36 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:18:36 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:18:36 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:18:36 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVfKuQLS9zJllhv3kPUB2y0LIrpoq5YmsKFSDmw9Tyo5dHzmOlJAAXufyDTFsBrKhHMJ-ZzdocNS3qpg7FWLQKIKwa7RDpF6LVZdgu1C335DDqKTvwa0xhCyj3oIlQ0dGxmOCpX9kwafqMrjqf9J9QvHN7rTroz01jXjjHzhDg6pqs8 Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Project-Id: 5db9634e91454f4f93654d4a4657a5e8 Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1843443076 Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5db9634e91454f4f93654d4a4657a5e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5db9634e91454f4f93654d4a4657a5e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5db9634e91454f4f93654d4a4657a5e8"}]}] Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1843443076 Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Tenant-Id: 5db9634e91454f4f93654d4a4657a5e8 Apr 20 15:18:36 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1843443076 Apr 20 15:18:36 user devstack@n-api.service[61509]: X-User: tempest-VolumesSnapshotsTestJSON-1843443076-project-member Apr 20 15:18:36 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:18:36 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:18:36 user devstack@n-api.service[61509]: X-User-Id: d49481554c9b47eb8efe3f06bf7c1bde Apr 20 15:18:36 user devstack@n-api.service[61509]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1843443076-project-member Apr 20 15:18:36 user devstack@n-api.service[61509]: method: Apr 20 15:18:36 user devstack@n-api.service[61509]: exception: Volume 5cbd4a55-33ee-4634-b569-22fd82fa247a could not be found. Apr 20 15:18:36 user devstack@n-api.service[61509]: action_args: {'id': '5cbd4a55-33ee-4634-b569-22fd82fa247a'} Apr 20 15:18:36 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5cbd4a55-33ee-4634-b569-22fd82fa247a could not be found. (HTTP 404) (Request-ID: req-360efba3-ce3e-49c1-b5c6-81ee557a47d4) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5cbd4a55-33ee-4634-b569-22fd82fa247a could not be found. Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5cbd4a55-33ee-4634-b569-22fd82fa247a could not be found. Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5cbd4a55-33ee-4634-b569-22fd82fa247a could not be found. Apr 20 15:18:36 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:18:36 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-96ca41bd-f0c3-4c20-9261-2f856a0702c3 tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] Returning 404 to user: Volume 5cbd4a55-33ee-4634-b569-22fd82fa247a could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:18:36 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-96ca41bd-f0c3-4c20-9261-2f856a0702c3 tempest-VolumesSnapshotsTestJSON-1843443076 tempest-VolumesSnapshotsTestJSON-1843443076-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5cbd4a55-33ee-4634-b569-22fd82fa247a" status: 404 len: 109 microversion: 2.1 time: 0.036960 Apr 20 15:18:36 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 123/369] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 15:18:36 2023] GET /compute/v2.1/os-volumes/5cbd4a55-33ee-4634-b569-22fd82fa247a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] [instance: 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:18:54 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] HTTP exception thrown: Instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 could not be found. Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Request method failure captured: Apr 20 15:18:54 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 HTTP/1.1 Apr 20 15:18:54 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:18:54 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:18:54 user devstack@n-api.service[61508]: Connection: close Apr 20 15:18:54 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:18:54 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:18:54 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:18:54 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:18:54 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVWkyBXvY6UZjnCugjjyakm7BAN9il6WMWd6FzgczquyuN_v0937tzd-RY3meTHvgtCizgGF1Lo1bYjYhgO3j3liR5TRa4-o-jSRjQhPKIte1OmbW-QQ1Igl6agKdh82fRexT_-0RTtOiTim7SCWe59Q3nbG2CPPrbIYtT74ucT9wEE Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Project-Id: 061d2444339049d0a0bb680f55ce75e3 Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Project-Name: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/061d2444339049d0a0bb680f55ce75e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/061d2444339049d0a0bb680f55ce75e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/061d2444339049d0a0bb680f55ce75e3"}]}] Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Tenant: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Tenant-Id: 061d2444339049d0a0bb680f55ce75e3 Apr 20 15:18:54 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1460486547 Apr 20 15:18:54 user devstack@n-api.service[61508]: X-User: tempest-ServersNegativeTestJSON-1460486547-project-member Apr 20 15:18:54 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:18:54 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:18:54 user devstack@n-api.service[61508]: X-User-Id: 515a83630b834f03a4fd748fb75b3550 Apr 20 15:18:54 user devstack@n-api.service[61508]: X-User-Name: tempest-ServersNegativeTestJSON-1460486547-project-member Apr 20 15:18:54 user devstack@n-api.service[61508]: method: > Apr 20 15:18:54 user devstack@n-api.service[61508]: exception: Instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 could not be found. Apr 20 15:18:54 user devstack@n-api.service[61508]: action_args: {'id': '5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82'} Apr 20 15:18:54 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 could not be found. Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 could not be found. Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 could not be found. Apr 20 15:18:54 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:18:54 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] Returning 404 to user: Instance 5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:18:54 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-ab3b9fe5-5033-4f38-a2b2-b10c1e036fd5 tempest-ServersNegativeTestJSON-1460486547 tempest-ServersNegativeTestJSON-1460486547-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82" status: 404 len: 111 microversion: 2.1 time: 0.034094 Apr 20 15:18:54 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 124/370] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:18:54 2023] GET /compute/v2.1/servers/5445d7bf-c70e-4aa8-b50c-1be8c2c9fb82 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:19:02 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:19:02 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:19:02 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:02 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:02 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:02 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:02 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:02 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:02 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] HTTP exception thrown: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:02 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Request method failure captured: Apr 20 15:19:02 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 HTTP/1.1 Apr 20 15:19:02 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:19:02 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:19:02 user devstack@n-api.service[61510]: Connection: close Apr 20 15:19:02 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:19:02 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:19:02 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:19:02 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:19:02 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVaYmQ7rYu1k3uG692uZxyih8IzIgtnYN18Z10C_0z2CG8bfjBibZDUn5Fk1hMa9cXN3ySp9G-ljaqvOLV0HqFOm7EpbcNOwW23fRjHMeSJUAB6TEl-QSpZM5QObD9jQhCH41PR7NRvucNqeIqHO3jHYbsHt0fYKU1udfi75q98MBq4 Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Project-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3bfe062836ab4f98866f6058a0a50f66"}]}] Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Tenant-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:19:02 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:02 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:19:02 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:19:02 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:19:02 user devstack@n-api.service[61510]: X-User-Id: bbd3a1bdaa3d4259a7f578e485a929ef Apr 20 15:19:02 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:19:02 user devstack@n-api.service[61510]: method: > Apr 20 15:19:02 user devstack@n-api.service[61510]: exception: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:02 user devstack@n-api.service[61510]: action_args: {'id': 'ff56ab94-63cf-4527-a46f-aa0a2adfcdc3'} Apr 20 15:19:02 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:02 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:19:02 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Returning 404 to user: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:19:02 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-dc578ac3-43bc-40e6-9c0e-aab2c42af216 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3" status: 404 len: 111 microversion: 2.20 time: 0.214940 Apr 20 15:19:02 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 124/371] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:19:02 2023] GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:19:02 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=4 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:02 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=8 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:02 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-0a3128b9-309d-408c-a03b-f75a6848db69 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '.version_select at 0x7fcbb38f77f0>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:19:02 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-0a3128b9-309d-408c-a03b-f75a6848db69 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515762926" status: 204 len: 0 microversion: 2.20 time: 0.028371 Apr 20 15:19:02 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 124/372] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 20 15:19:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515762926 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:03 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] HTTP exception thrown: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Request method failure captured: Apr 20 15:19:03 user devstack@n-api.service[61508]: request: DELETE /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 HTTP/1.1 Apr 20 15:19:03 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:19:03 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:19:03 user devstack@n-api.service[61508]: Connection: close Apr 20 15:19:03 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:19:03 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:19:03 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:19:03 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:19:03 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVaYmQ7rYu1k3uG692uZxyih8IzIgtnYN18Z10C_0z2CG8bfjBibZDUn5Fk1hMa9cXN3ySp9G-ljaqvOLV0HqFOm7EpbcNOwW23fRjHMeSJUAB6TEl-QSpZM5QObD9jQhCH41PR7NRvucNqeIqHO3jHYbsHt0fYKU1udfi75q98MBq4 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Project-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3bfe062836ab4f98866f6058a0a50f66"}]}] Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Tenant-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-User: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:19:03 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:19:03 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:19:03 user devstack@n-api.service[61508]: X-User-Id: bbd3a1bdaa3d4259a7f578e485a929ef Apr 20 15:19:03 user devstack@n-api.service[61508]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:19:03 user devstack@n-api.service[61508]: method: > Apr 20 15:19:03 user devstack@n-api.service[61508]: exception: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:03 user devstack@n-api.service[61508]: action_args: {'id': 'ff56ab94-63cf-4527-a46f-aa0a2adfcdc3'} Apr 20 15:19:03 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Returning 404 to user: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:19:03 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-ba2006b8-7f24-4a4c-a33f-4066bd6b046f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3" status: 404 len: 111 microversion: 2.20 time: 0.030305 Apr 20 15:19:03 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 125/373] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 15:19:03 2023] DELETE /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:19:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:19:03 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: ff56ab94-63cf-4527-a46f-aa0a2adfcdc3] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:19:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] HTTP exception thrown: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Request method failure captured: Apr 20 15:19:03 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 HTTP/1.1 Apr 20 15:19:03 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:19:03 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:19:03 user devstack@n-api.service[61510]: Connection: close Apr 20 15:19:03 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:19:03 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:19:03 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:19:03 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:19:03 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVaYmQ7rYu1k3uG692uZxyih8IzIgtnYN18Z10C_0z2CG8bfjBibZDUn5Fk1hMa9cXN3ySp9G-ljaqvOLV0HqFOm7EpbcNOwW23fRjHMeSJUAB6TEl-QSpZM5QObD9jQhCH41PR7NRvucNqeIqHO3jHYbsHt0fYKU1udfi75q98MBq4 Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Project-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3bfe062836ab4f98866f6058a0a50f66"}]}] Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Tenant-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:19:03 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:19:03 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:19:03 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:19:03 user devstack@n-api.service[61510]: X-User-Id: bbd3a1bdaa3d4259a7f578e485a929ef Apr 20 15:19:03 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:19:03 user devstack@n-api.service[61510]: method: > Apr 20 15:19:03 user devstack@n-api.service[61510]: exception: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:03 user devstack@n-api.service[61510]: action_args: {'id': 'ff56ab94-63cf-4527-a46f-aa0a2adfcdc3'} Apr 20 15:19:03 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. Apr 20 15:19:03 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Returning 404 to user: Instance ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:19:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-51b987a3-8016-41ea-8ec4-d64f68419555 tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3" status: 404 len: 111 microversion: 2.20 time: 0.028845 Apr 20 15:19:03 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 125/374] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:19:03 2023] GET /compute/v2.1/servers/ff56ab94-63cf-4527-a46f-aa0a2adfcdc3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:19:03 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:19:03 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:19:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:03 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:03 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] HTTP exception thrown: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:19:03 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Request method failure captured: Apr 20 15:19:03 user devstack@n-api.service[61509]: request: DELETE /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a HTTP/1.1 Apr 20 15:19:03 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:19:03 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:19:03 user devstack@n-api.service[61509]: Connection: close Apr 20 15:19:03 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:19:03 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:19:03 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:19:03 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:19:03 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVaYmQ7rYu1k3uG692uZxyih8IzIgtnYN18Z10C_0z2CG8bfjBibZDUn5Fk1hMa9cXN3ySp9G-ljaqvOLV0HqFOm7EpbcNOwW23fRjHMeSJUAB6TEl-QSpZM5QObD9jQhCH41PR7NRvucNqeIqHO3jHYbsHt0fYKU1udfi75q98MBq4 Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Project-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3bfe062836ab4f98866f6058a0a50f66"}]}] Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Tenant-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:19:03 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61509]: X-User: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:19:03 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:19:03 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:19:03 user devstack@n-api.service[61509]: X-User-Id: bbd3a1bdaa3d4259a7f578e485a929ef Apr 20 15:19:03 user devstack@n-api.service[61509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:19:03 user devstack@n-api.service[61509]: method: > Apr 20 15:19:03 user devstack@n-api.service[61509]: exception: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:19:03 user devstack@n-api.service[61509]: action_args: {'id': 'e3055a84-dc65-4914-9d37-69d65383784a'} Apr 20 15:19:03 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:19:03 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Returning 404 to user: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:19:03 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-f416a577-464a-4fe0-ab83-cfa06f959d5f tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a" status: 404 len: 111 microversion: 2.20 time: 0.085176 Apr 20 15:19:03 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 125/375] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 15:19:03 2023] DELETE /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] [instance: e3055a84-dc65-4914-9d37-69d65383784a] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:03 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] HTTP exception thrown: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Request method failure captured: Apr 20 15:19:03 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a HTTP/1.1 Apr 20 15:19:03 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:19:03 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:19:03 user devstack@n-api.service[61508]: Connection: close Apr 20 15:19:03 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:19:03 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:19:03 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:19:03 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:19:03 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVaYmQ7rYu1k3uG692uZxyih8IzIgtnYN18Z10C_0z2CG8bfjBibZDUn5Fk1hMa9cXN3ySp9G-ljaqvOLV0HqFOm7EpbcNOwW23fRjHMeSJUAB6TEl-QSpZM5QObD9jQhCH41PR7NRvucNqeIqHO3jHYbsHt0fYKU1udfi75q98MBq4 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Project-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3bfe062836ab4f98866f6058a0a50f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3bfe062836ab4f98866f6058a0a50f66"}]}] Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Tenant-Id: 3bfe062836ab4f98866f6058a0a50f66 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1790805790 Apr 20 15:19:03 user devstack@n-api.service[61508]: X-User: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:19:03 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:19:03 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:19:03 user devstack@n-api.service[61508]: X-User-Id: bbd3a1bdaa3d4259a7f578e485a929ef Apr 20 15:19:03 user devstack@n-api.service[61508]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1790805790-project-member Apr 20 15:19:03 user devstack@n-api.service[61508]: method: > Apr 20 15:19:03 user devstack@n-api.service[61508]: exception: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:19:03 user devstack@n-api.service[61508]: action_args: {'id': 'e3055a84-dc65-4914-9d37-69d65383784a'} Apr 20 15:19:03 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. Apr 20 15:19:03 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:19:03 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] Returning 404 to user: Instance e3055a84-dc65-4914-9d37-69d65383784a could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:19:03 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-29648044-ccf5-4258-a19f-eae6dfc51ecd tempest-AttachVolumeShelveTestJSON-1790805790 tempest-AttachVolumeShelveTestJSON-1790805790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a" status: 404 len: 111 microversion: 2.20 time: 0.026885 Apr 20 15:19:03 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 126/376] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 15:19:03 2023] GET /compute/v2.1/servers/e3055a84-dc65-4914-9d37-69d65383784a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 15:19:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-acbee035-dfcb-4e21-9ede-aede7f3dca9a tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Action: 'create', calling method: .version_select at 0x7fcbb36052d0>, body: {"keypair": {"name": "tempest-keypair-762607479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0dl9n5sqVt2fCehroKJ+rzze8lGS7zEiyBmcjJD4ezZBrOyErqR8NExskPrImE2ZkRRVMEwxTmSc83N9JbJaUSqCxbL+JS0nM+FjTlOfpGyRK86jGKMPqrwc2RGi0uFw=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:19:04 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-acbee035-dfcb-4e21-9ede-aede7f3dca9a tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Getting quotas for project 2692d58f90a145049b98bfe08b158531. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:19:04 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-acbee035-dfcb-4e21-9ede-aede7f3dca9a tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Getting quotas for user 496c0591e87641849b53fda57e1dece7 and project 2692d58f90a145049b98bfe08b158531. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:19:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-acbee035-dfcb-4e21-9ede-aede7f3dca9a tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088923 Apr 20 15:19:04 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 126/377] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:19:04 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:19:06 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-297005174", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "79555824-7b3f-4ed2-b076-92c2ebdf36b9"}], "security_groups": [{"name": "tempest-securitygroup--1085529907"}], "key_name": "tempest-keypair-762607479", "user_data": "}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:19:06 user devstack@n-api.service[61509]: DEBUG nova.network.neutron [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] validate_networks() for [('79555824-7b3f-4ed2-b076-92c2ebdf36b9', None, None, None, None, None)] {{(pid=61509) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Flavor limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Image limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Flavor pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Image pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Getting quotas for project 2692d58f90a145049b98bfe08b158531. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Getting quotas for user 496c0591e87641849b53fda57e1dece7 and project 2692d58f90a145049b98bfe08b158531. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Going to run 1 instances... {{(pid=61509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:19:07 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:19:07 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-a6398ee0-1b75-43ad-941e-5ef208bb2ac6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.958413 Apr 20 15:19:07 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 126/378] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:19:06 2023] POST /compute/v2.1/servers => generated 400 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:19:07 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-2c24092d-2b4b-4d11-bb06-6e0a7aea41f1 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:19:07 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-2c24092d-2b4b-4d11-bb06-6e0a7aea41f1 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:19:07 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-2c24092d-2b4b-4d11-bb06-6e0a7aea41f1 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496c0591e87641849b53fda57e1dece7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2692d58f90a145049b98bfe08b158531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:19:07 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-2c24092d-2b4b-4d11-bb06-6e0a7aea41f1 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef" status: 200 len: 1230 microversion: 2.1 time: 0.064940 Apr 20 15:19:07 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 127/379] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:19:07 2023] GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef => generated 1230 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:19:10 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-e163928d-165c-41aa-896e-cf02da805407 req-2a16d969-6bae-403b-8913-530fb60d4869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62465ed7-8fe3-41fd-bc23-bafafec57cef", "tag": "eae282fe-8d81-4319-ba27-6df57a7b696c"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:19:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e163928d-165c-41aa-896e-cf02da805407 req-2a16d969-6bae-403b-8913-530fb60d4869 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e163928d-165c-41aa-896e-cf02da805407 req-2a16d969-6bae-403b-8913-530fb60d4869 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e163928d-165c-41aa-896e-cf02da805407 req-2a16d969-6bae-403b-8913-530fb60d4869 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-e163928d-165c-41aa-896e-cf02da805407 req-2a16d969-6bae-403b-8913-530fb60d4869 service nova] Creating event network-changed:eae282fe-8d81-4319-ba27-6df57a7b696c for instance 62465ed7-8fe3-41fd-bc23-bafafec57cef on user Apr 20 15:19:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-e163928d-165c-41aa-896e-cf02da805407 req-2a16d969-6bae-403b-8913-530fb60d4869 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031011 Apr 20 15:19:10 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 127/380] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:19:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:19:12 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-54e7c90a-7e6f-4980-8b00-4cfeee89d2a4 req-e80fb6a0-1e79-470a-8d24-f27fe3083897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62465ed7-8fe3-41fd-bc23-bafafec57cef", "name": "network-vif-plugged", "status": "completed", "tag": "eae282fe-8d81-4319-ba27-6df57a7b696c"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:19:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-54e7c90a-7e6f-4980-8b00-4cfeee89d2a4 req-e80fb6a0-1e79-470a-8d24-f27fe3083897 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-54e7c90a-7e6f-4980-8b00-4cfeee89d2a4 req-e80fb6a0-1e79-470a-8d24-f27fe3083897 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:12 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-54e7c90a-7e6f-4980-8b00-4cfeee89d2a4 req-e80fb6a0-1e79-470a-8d24-f27fe3083897 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:12 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-54e7c90a-7e6f-4980-8b00-4cfeee89d2a4 req-e80fb6a0-1e79-470a-8d24-f27fe3083897 service nova] Creating event network-vif-plugged:eae282fe-8d81-4319-ba27-6df57a7b696c for instance 62465ed7-8fe3-41fd-bc23-bafafec57cef on user Apr 20 15:19:12 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-54e7c90a-7e6f-4980-8b00-4cfeee89d2a4 req-e80fb6a0-1e79-470a-8d24-f27fe3083897 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032861 Apr 20 15:19:12 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 127/381] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:19:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:19:14 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-fd03931d-7ef1-49eb-880e-e3a016800d62 req-e5cae21d-289f-4ac1-842b-9261f23e5521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62465ed7-8fe3-41fd-bc23-bafafec57cef", "name": "network-vif-plugged", "status": "completed", "tag": "eae282fe-8d81-4319-ba27-6df57a7b696c"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:19:14 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:14 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-fd03931d-7ef1-49eb-880e-e3a016800d62 req-e5cae21d-289f-4ac1-842b-9261f23e5521 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:14 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-fd03931d-7ef1-49eb-880e-e3a016800d62 req-e5cae21d-289f-4ac1-842b-9261f23e5521 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:14 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-fd03931d-7ef1-49eb-880e-e3a016800d62 req-e5cae21d-289f-4ac1-842b-9261f23e5521 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:14 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-fd03931d-7ef1-49eb-880e-e3a016800d62 req-e5cae21d-289f-4ac1-842b-9261f23e5521 service nova] Creating event network-vif-plugged:eae282fe-8d81-4319-ba27-6df57a7b696c for instance 62465ed7-8fe3-41fd-bc23-bafafec57cef on user Apr 20 15:19:14 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-fd03931d-7ef1-49eb-880e-e3a016800d62 req-e5cae21d-289f-4ac1-842b-9261f23e5521 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033226 Apr 20 15:19:14 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 128/382] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:19:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-2a815a7e-bb46-4be3-9a7a-c6e9b72e2371 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-2a815a7e-bb46-4be3-9a7a-c6e9b72e2371 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 66242fcd-cd65-442b-8643-b33fe81a8061] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2a815a7e-bb46-4be3-9a7a-c6e9b72e2371 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2a815a7e-bb46-4be3-9a7a-c6e9b72e2371 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2a815a7e-bb46-4be3-9a7a-c6e9b72e2371 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2a815a7e-bb46-4be3-9a7a-c6e9b72e2371 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2a815a7e-bb46-4be3-9a7a-c6e9b72e2371 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2a815a7e-bb46-4be3-9a7a-c6e9b72e2371 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:27 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-2a815a7e-bb46-4be3-9a7a-c6e9b72e2371 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 66242fcd-cd65-442b-8643-b33fe81a8061] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:19:27 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-2a815a7e-bb46-4be3-9a7a-c6e9b72e2371 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061" status: 204 len: 0 microversion: 2.1 time: 0.123955 Apr 20 15:19:27 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 128/383] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:19:27 2023] DELETE /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-7d646863-9117-420f-8551-56f0251f0ee1 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-7d646863-9117-420f-8551-56f0251f0ee1 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 66242fcd-cd65-442b-8643-b33fe81a8061] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7d646863-9117-420f-8551-56f0251f0ee1 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7d646863-9117-420f-8551-56f0251f0ee1 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7d646863-9117-420f-8551-56f0251f0ee1 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7d646863-9117-420f-8551-56f0251f0ee1 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7d646863-9117-420f-8551-56f0251f0ee1 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:27 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-7d646863-9117-420f-8551-56f0251f0ee1 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:28 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:28 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=12 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:28 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:28 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-2ed367d0-ba35-4c28-aef4-9c767d580710 req-c82d96fa-12e2-48b1-8584-5dc34492c5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66242fcd-cd65-442b-8643-b33fe81a8061", "name": "network-vif-unplugged", "status": "completed", "tag": "fa3c5cc7-be23-4a32-823e-086e69742eda"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:19:28 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-2ed367d0-ba35-4c28-aef4-9c767d580710 req-c82d96fa-12e2-48b1-8584-5dc34492c5b3 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:28 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-2ed367d0-ba35-4c28-aef4-9c767d580710 req-c82d96fa-12e2-48b1-8584-5dc34492c5b3 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:28 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-2ed367d0-ba35-4c28-aef4-9c767d580710 req-c82d96fa-12e2-48b1-8584-5dc34492c5b3 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:28 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-2ed367d0-ba35-4c28-aef4-9c767d580710 req-c82d96fa-12e2-48b1-8584-5dc34492c5b3 service nova] Creating event network-vif-unplugged:fa3c5cc7-be23-4a32-823e-086e69742eda for instance 66242fcd-cd65-442b-8643-b33fe81a8061 on user Apr 20 15:19:28 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-2ed367d0-ba35-4c28-aef4-9c767d580710 req-c82d96fa-12e2-48b1-8584-5dc34492c5b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168763 Apr 20 15:19:28 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 129/384] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:19:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:19:28 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-7d646863-9117-420f-8551-56f0251f0ee1 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02e13ff5394016b693bfb61c0dd244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277c8babb24c43c6b386883035b7476c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:19:28 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-7d646863-9117-420f-8551-56f0251f0ee1 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061" status: 200 len: 1495 microversion: 2.1 time: 0.727409 Apr 20 15:19:28 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:19:27 2023] GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061 => generated 1495 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:19:28 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-7aeb42e7-d030-4564-9d7a-2cc4837b9b93 req-6c1e5290-2ff3-4bef-8d83-b167ed27ff78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66242fcd-cd65-442b-8643-b33fe81a8061", "name": "network-vif-deleted", "tag": "fa3c5cc7-be23-4a32-823e-086e69742eda"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:19:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-7aeb42e7-d030-4564-9d7a-2cc4837b9b93 req-6c1e5290-2ff3-4bef-8d83-b167ed27ff78 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-7aeb42e7-d030-4564-9d7a-2cc4837b9b93 req-6c1e5290-2ff3-4bef-8d83-b167ed27ff78 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-7aeb42e7-d030-4564-9d7a-2cc4837b9b93 req-6c1e5290-2ff3-4bef-8d83-b167ed27ff78 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:29 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-7aeb42e7-d030-4564-9d7a-2cc4837b9b93 req-6c1e5290-2ff3-4bef-8d83-b167ed27ff78 service nova] Creating event network-vif-deleted:fa3c5cc7-be23-4a32-823e-086e69742eda for instance 66242fcd-cd65-442b-8643-b33fe81a8061 on user Apr 20 15:19:29 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-7aeb42e7-d030-4564-9d7a-2cc4837b9b93 req-6c1e5290-2ff3-4bef-8d83-b167ed27ff78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029636 Apr 20 15:19:29 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 129/386] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:19:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:19:30 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-91ef4de4-6a3f-4b08-9f8c-ffcac110252d req-c48d39eb-67f7-4d75-a149-f7a972ccaaec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66242fcd-cd65-442b-8643-b33fe81a8061", "name": "network-vif-plugged", "status": "completed", "tag": "fa3c5cc7-be23-4a32-823e-086e69742eda"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:19:30 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-91ef4de4-6a3f-4b08-9f8c-ffcac110252d req-c48d39eb-67f7-4d75-a149-f7a972ccaaec service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:30 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-91ef4de4-6a3f-4b08-9f8c-ffcac110252d req-c48d39eb-67f7-4d75-a149-f7a972ccaaec service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:30 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-91ef4de4-6a3f-4b08-9f8c-ffcac110252d req-c48d39eb-67f7-4d75-a149-f7a972ccaaec service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:30 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-91ef4de4-6a3f-4b08-9f8c-ffcac110252d req-c48d39eb-67f7-4d75-a149-f7a972ccaaec service nova] Creating event network-vif-plugged:fa3c5cc7-be23-4a32-823e-086e69742eda for instance 66242fcd-cd65-442b-8643-b33fe81a8061 on user Apr 20 15:19:30 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-91ef4de4-6a3f-4b08-9f8c-ffcac110252d req-c48d39eb-67f7-4d75-a149-f7a972ccaaec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035682 Apr 20 15:19:30 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 130/387] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:19:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-891cca34-4133-4ec6-bf8e-d7ef23864c32 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-891cca34-4133-4ec6-bf8e-d7ef23864c32 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-891cca34-4133-4ec6-bf8e-d7ef23864c32 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-891cca34-4133-4ec6-bf8e-d7ef23864c32 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-891cca34-4133-4ec6-bf8e-d7ef23864c32 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-891cca34-4133-4ec6-bf8e-d7ef23864c32 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-891cca34-4133-4ec6-bf8e-d7ef23864c32 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-891cca34-4133-4ec6-bf8e-d7ef23864c32 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:19:57 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-891cca34-4133-4ec6-bf8e-d7ef23864c32 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496c0591e87641849b53fda57e1dece7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2692d58f90a145049b98bfe08b158531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:19:57 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-891cca34-4133-4ec6-bf8e-d7ef23864c32 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef" status: 200 len: 1536 microversion: 2.1 time: 0.242705 Apr 20 15:19:57 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 129/388] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:19:57 2023] GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef => generated 1536 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 66242fcd-cd65-442b-8643-b33fe81a8061] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:18 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] HTTP exception thrown: Instance 66242fcd-cd65-442b-8643-b33fe81a8061 could not be found. Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Request method failure captured: Apr 20 15:20:18 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061 HTTP/1.1 Apr 20 15:20:18 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:20:18 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:20:18 user devstack@n-api.service[61510]: Connection: close Apr 20 15:20:18 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:20:18 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:20:18 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:20:18 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:20:18 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVbhpfWmId38E9X-or8YLnrefOTQ7NqgWlAyhz7gxXNlgVCzOD9GC5hflVevmR4_zDbtAjoPUWwZUbPt6-etwzb1H9bDvjLJkvyoi88No1YVWhTqvFcCYwW4JlXUCs-dnPYmM5-N9Ia0vRVsUNNSMQFCb8Y4hhR8xWA4cKfVWKx_OT8 Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Project-Id: 277c8babb24c43c6b386883035b7476c Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-468060921 Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/277c8babb24c43c6b386883035b7476c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/277c8babb24c43c6b386883035b7476c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/277c8babb24c43c6b386883035b7476c"}]}] Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Tenant: tempest-ServerRescueNegativeTestJSON-468060921 Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Tenant-Id: 277c8babb24c43c6b386883035b7476c Apr 20 15:20:18 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-468060921 Apr 20 15:20:18 user devstack@n-api.service[61510]: X-User: tempest-ServerRescueNegativeTestJSON-468060921-project-member Apr 20 15:20:18 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:20:18 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:20:18 user devstack@n-api.service[61510]: X-User-Id: cd02e13ff5394016b693bfb61c0dd244 Apr 20 15:20:18 user devstack@n-api.service[61510]: X-User-Name: tempest-ServerRescueNegativeTestJSON-468060921-project-member Apr 20 15:20:18 user devstack@n-api.service[61510]: method: > Apr 20 15:20:18 user devstack@n-api.service[61510]: exception: Instance 66242fcd-cd65-442b-8643-b33fe81a8061 could not be found. Apr 20 15:20:18 user devstack@n-api.service[61510]: action_args: {'id': '66242fcd-cd65-442b-8643-b33fe81a8061'} Apr 20 15:20:18 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66242fcd-cd65-442b-8643-b33fe81a8061 could not be found. Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66242fcd-cd65-442b-8643-b33fe81a8061 could not be found. Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66242fcd-cd65-442b-8643-b33fe81a8061 could not be found. Apr 20 15:20:18 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:20:18 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Returning 404 to user: Instance 66242fcd-cd65-442b-8643-b33fe81a8061 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:20:18 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b166457d-8e61-4788-aadc-6129b9770108 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061" status: 404 len: 111 microversion: 2.1 time: 0.287591 Apr 20 15:20:18 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 130/389] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:20:18 2023] GET /compute/v2.1/servers/66242fcd-cd65-442b-8643-b33fe81a8061 => generated 111 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-519ae2b9-b69a-4d3c-b46b-ac66f80161fe tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-519ae2b9-b69a-4d3c-b46b-ac66f80161fe tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 32f44a87-50b3-449f-83dc-a7102cf727c5] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-519ae2b9-b69a-4d3c-b46b-ac66f80161fe tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-519ae2b9-b69a-4d3c-b46b-ac66f80161fe tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-519ae2b9-b69a-4d3c-b46b-ac66f80161fe tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-519ae2b9-b69a-4d3c-b46b-ac66f80161fe tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-519ae2b9-b69a-4d3c-b46b-ac66f80161fe tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-519ae2b9-b69a-4d3c-b46b-ac66f80161fe tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:18 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-519ae2b9-b69a-4d3c-b46b-ac66f80161fe tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 32f44a87-50b3-449f-83dc-a7102cf727c5] Going to try to terminate instance {{(pid=61508) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:20:18 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-519ae2b9-b69a-4d3c-b46b-ac66f80161fe tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5" status: 204 len: 0 microversion: 2.1 time: 0.118366 Apr 20 15:20:18 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 131/390] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:20:18 2023] DELETE /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:20:18 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-64868786-6201-4876-8f39-65f32feba88a tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:20:18 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-64868786-6201-4876-8f39-65f32feba88a tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 32f44a87-50b3-449f-83dc-a7102cf727c5] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:20:18 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:18 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-64868786-6201-4876-8f39-65f32feba88a tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-64868786-6201-4876-8f39-65f32feba88a tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-64868786-6201-4876-8f39-65f32feba88a tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-64868786-6201-4876-8f39-65f32feba88a tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-64868786-6201-4876-8f39-65f32feba88a tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:18 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-64868786-6201-4876-8f39-65f32feba88a tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:19 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-64868786-6201-4876-8f39-65f32feba88a tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02e13ff5394016b693bfb61c0dd244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277c8babb24c43c6b386883035b7476c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:20:19 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-64868786-6201-4876-8f39-65f32feba88a tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5" status: 200 len: 1509 microversion: 2.1 time: 0.260602 Apr 20 15:20:19 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 130/391] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:20:18 2023] GET /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5 => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:20:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-51dc9e6b-d2ef-4d02-a6fb-0ac8e5dfe3b1 req-cba860df-b411-4e4a-8828-59ce09196184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f44a87-50b3-449f-83dc-a7102cf727c5", "name": "network-vif-unplugged", "status": "completed", "tag": "e41b3010-3209-45da-85ac-c0ae82f1938c"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:20:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-51dc9e6b-d2ef-4d02-a6fb-0ac8e5dfe3b1 req-cba860df-b411-4e4a-8828-59ce09196184 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-51dc9e6b-d2ef-4d02-a6fb-0ac8e5dfe3b1 req-cba860df-b411-4e4a-8828-59ce09196184 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-51dc9e6b-d2ef-4d02-a6fb-0ac8e5dfe3b1 req-cba860df-b411-4e4a-8828-59ce09196184 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:19 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-51dc9e6b-d2ef-4d02-a6fb-0ac8e5dfe3b1 req-cba860df-b411-4e4a-8828-59ce09196184 service nova] Creating event network-vif-unplugged:e41b3010-3209-45da-85ac-c0ae82f1938c for instance 32f44a87-50b3-449f-83dc-a7102cf727c5 on user Apr 20 15:20:19 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-51dc9e6b-d2ef-4d02-a6fb-0ac8e5dfe3b1 req-cba860df-b411-4e4a-8828-59ce09196184 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086291 Apr 20 15:20:19 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 131/392] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:20:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:20:20 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-5948f728-6d1a-4a94-a00b-478aee6116d5 req-3cb7285b-d87f-45fd-be0d-5e0ae962335b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f44a87-50b3-449f-83dc-a7102cf727c5", "name": "network-vif-deleted", "tag": "e41b3010-3209-45da-85ac-c0ae82f1938c"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:20:20 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-5948f728-6d1a-4a94-a00b-478aee6116d5 req-3cb7285b-d87f-45fd-be0d-5e0ae962335b service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:20 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-5948f728-6d1a-4a94-a00b-478aee6116d5 req-3cb7285b-d87f-45fd-be0d-5e0ae962335b service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:20 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-5948f728-6d1a-4a94-a00b-478aee6116d5 req-3cb7285b-d87f-45fd-be0d-5e0ae962335b service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:20 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-5948f728-6d1a-4a94-a00b-478aee6116d5 req-3cb7285b-d87f-45fd-be0d-5e0ae962335b service nova] Creating event network-vif-deleted:e41b3010-3209-45da-85ac-c0ae82f1938c for instance 32f44a87-50b3-449f-83dc-a7102cf727c5 on user Apr 20 15:20:20 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-5948f728-6d1a-4a94-a00b-478aee6116d5 req-3cb7285b-d87f-45fd-be0d-5e0ae962335b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027638 Apr 20 15:20:20 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 132/393] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:20:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:20:21 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-ad62069d-3b1c-4cec-918e-0976149188a1 req-d9da48b5-e96c-4f55-af67-0c052d1f6875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f44a87-50b3-449f-83dc-a7102cf727c5", "name": "network-vif-plugged", "status": "completed", "tag": "e41b3010-3209-45da-85ac-c0ae82f1938c"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:20:21 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-ad62069d-3b1c-4cec-918e-0976149188a1 req-d9da48b5-e96c-4f55-af67-0c052d1f6875 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:21 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-ad62069d-3b1c-4cec-918e-0976149188a1 req-d9da48b5-e96c-4f55-af67-0c052d1f6875 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:21 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-ad62069d-3b1c-4cec-918e-0976149188a1 req-d9da48b5-e96c-4f55-af67-0c052d1f6875 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:21 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-ad62069d-3b1c-4cec-918e-0976149188a1 req-d9da48b5-e96c-4f55-af67-0c052d1f6875 service nova] Creating event network-vif-plugged:e41b3010-3209-45da-85ac-c0ae82f1938c for instance 32f44a87-50b3-449f-83dc-a7102cf727c5 on user Apr 20 15:20:21 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-ad62069d-3b1c-4cec-918e-0976149188a1 req-d9da48b5-e96c-4f55-af67-0c052d1f6875 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028899 Apr 20 15:20:21 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 131/394] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:20:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:20:58 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:58 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:58 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-dd06e97b-bbb9-40f8-8f93-1c30d426a73f tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:20:58 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-dd06e97b-bbb9-40f8-8f93-1c30d426a73f tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:20:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dd06e97b-bbb9-40f8-8f93-1c30d426a73f tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dd06e97b-bbb9-40f8-8f93-1c30d426a73f tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dd06e97b-bbb9-40f8-8f93-1c30d426a73f tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dd06e97b-bbb9-40f8-8f93-1c30d426a73f tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dd06e97b-bbb9-40f8-8f93-1c30d426a73f tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dd06e97b-bbb9-40f8-8f93-1c30d426a73f tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-dd06e97b-bbb9-40f8-8f93-1c30d426a73f tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.160162 Apr 20 15:20:58 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 132/395] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 15:20:58 2023] GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef/os-interface => generated 282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:20:58 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:58 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:59 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=4 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:59 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=8 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:20:59 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-e911f22a-f829-48d7-bc9e-1c87ee165140 req-fd0f7e33-6f2e-4426-8898-6aa39570255a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62465ed7-8fe3-41fd-bc23-bafafec57cef", "tag": "eae282fe-8d81-4319-ba27-6df57a7b696c"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:20:59 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-63140757-b0d9-411a-bc4b-fe59f8535aa2 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:20:59 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-63140757-b0d9-411a-bc4b-fe59f8535aa2 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:20:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-63140757-b0d9-411a-bc4b-fe59f8535aa2 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:59 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-e911f22a-f829-48d7-bc9e-1c87ee165140 req-fd0f7e33-6f2e-4426-8898-6aa39570255a service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:59 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-e911f22a-f829-48d7-bc9e-1c87ee165140 req-fd0f7e33-6f2e-4426-8898-6aa39570255a service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-63140757-b0d9-411a-bc4b-fe59f8535aa2 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:59 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-e911f22a-f829-48d7-bc9e-1c87ee165140 req-fd0f7e33-6f2e-4426-8898-6aa39570255a service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-63140757-b0d9-411a-bc4b-fe59f8535aa2 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-63140757-b0d9-411a-bc4b-fe59f8535aa2 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:20:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-63140757-b0d9-411a-bc4b-fe59f8535aa2 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:20:59 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-63140757-b0d9-411a-bc4b-fe59f8535aa2 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:20:59 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-e911f22a-f829-48d7-bc9e-1c87ee165140 req-fd0f7e33-6f2e-4426-8898-6aa39570255a service nova] Creating event network-changed:eae282fe-8d81-4319-ba27-6df57a7b696c for instance 62465ed7-8fe3-41fd-bc23-bafafec57cef on user Apr 20 15:20:59 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-e911f22a-f829-48d7-bc9e-1c87ee165140 req-fd0f7e33-6f2e-4426-8898-6aa39570255a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093604 Apr 20 15:20:59 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 133/396] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:20:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:20:59 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-63140757-b0d9-411a-bc4b-fe59f8535aa2 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef/ips" status: 200 len: 104 microversion: 2.1 time: 0.049334 Apr 20 15:20:59 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 132/397] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 15:20:59 2023] GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef/ips => generated 104 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:21:00 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-2c1a3ad0-bfc6-477d-8fbc-b3b8b42b04f8 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:21:00 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-2c1a3ad0-bfc6-477d-8fbc-b3b8b42b04f8 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:21:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2c1a3ad0-bfc6-477d-8fbc-b3b8b42b04f8 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2c1a3ad0-bfc6-477d-8fbc-b3b8b42b04f8 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2c1a3ad0-bfc6-477d-8fbc-b3b8b42b04f8 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2c1a3ad0-bfc6-477d-8fbc-b3b8b42b04f8 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2c1a3ad0-bfc6-477d-8fbc-b3b8b42b04f8 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2c1a3ad0-bfc6-477d-8fbc-b3b8b42b04f8 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:00 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-2c1a3ad0-bfc6-477d-8fbc-b3b8b42b04f8 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:21:00 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-2c1a3ad0-bfc6-477d-8fbc-b3b8b42b04f8 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef" status: 204 len: 0 microversion: 2.1 time: 0.103527 Apr 20 15:21:00 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:21:00 2023] DELETE /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:21:00 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-918534d8-bc47-4c1f-858b-900596765cae tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:21:00 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-918534d8-bc47-4c1f-858b-900596765cae tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:21:00 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-918534d8-bc47-4c1f-858b-900596765cae tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:00 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-918534d8-bc47-4c1f-858b-900596765cae tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:00 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-918534d8-bc47-4c1f-858b-900596765cae tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:00 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-918534d8-bc47-4c1f-858b-900596765cae tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:00 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-918534d8-bc47-4c1f-858b-900596765cae tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:00 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-918534d8-bc47-4c1f-858b-900596765cae tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:00 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-918534d8-bc47-4c1f-858b-900596765cae tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496c0591e87641849b53fda57e1dece7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2692d58f90a145049b98bfe08b158531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:21:01 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-918534d8-bc47-4c1f-858b-900596765cae tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef" status: 200 len: 1661 microversion: 2.1 time: 0.248816 Apr 20 15:21:01 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 134/399] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:21:00 2023] GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef => generated 1661 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:21:01 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-2923c06e-85de-4063-a1d6-c739fa6bd4d0 req-e6feae3b-ade4-434d-bf73-ef02073d06c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62465ed7-8fe3-41fd-bc23-bafafec57cef", "name": "network-vif-unplugged", "status": "completed", "tag": "eae282fe-8d81-4319-ba27-6df57a7b696c"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:21:01 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-2923c06e-85de-4063-a1d6-c739fa6bd4d0 req-e6feae3b-ade4-434d-bf73-ef02073d06c3 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:01 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-2923c06e-85de-4063-a1d6-c739fa6bd4d0 req-e6feae3b-ade4-434d-bf73-ef02073d06c3 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:01 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-2923c06e-85de-4063-a1d6-c739fa6bd4d0 req-e6feae3b-ade4-434d-bf73-ef02073d06c3 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:01 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-2923c06e-85de-4063-a1d6-c739fa6bd4d0 req-e6feae3b-ade4-434d-bf73-ef02073d06c3 service nova] Creating event network-vif-unplugged:eae282fe-8d81-4319-ba27-6df57a7b696c for instance 62465ed7-8fe3-41fd-bc23-bafafec57cef on user Apr 20 15:21:01 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-2923c06e-85de-4063-a1d6-c739fa6bd4d0 req-e6feae3b-ade4-434d-bf73-ef02073d06c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034264 Apr 20 15:21:01 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 133/400] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:21:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:21:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-ab210d35-33d7-4e0e-bcc1-047b950cc2ec req-90034077-0107-4d25-baa2-be0df3bebe96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62465ed7-8fe3-41fd-bc23-bafafec57cef", "name": "network-vif-plugged", "status": "completed", "tag": "eae282fe-8d81-4319-ba27-6df57a7b696c"}, {"server_uuid": "62465ed7-8fe3-41fd-bc23-bafafec57cef", "name": "network-vif-deleted", "tag": "eae282fe-8d81-4319-ba27-6df57a7b696c"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:21:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ab210d35-33d7-4e0e-bcc1-047b950cc2ec req-90034077-0107-4d25-baa2-be0df3bebe96 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ab210d35-33d7-4e0e-bcc1-047b950cc2ec req-90034077-0107-4d25-baa2-be0df3bebe96 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ab210d35-33d7-4e0e-bcc1-047b950cc2ec req-90034077-0107-4d25-baa2-be0df3bebe96 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-ab210d35-33d7-4e0e-bcc1-047b950cc2ec req-90034077-0107-4d25-baa2-be0df3bebe96 service nova] Creating event network-vif-plugged:eae282fe-8d81-4319-ba27-6df57a7b696c for instance 62465ed7-8fe3-41fd-bc23-bafafec57cef on user Apr 20 15:21:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-ab210d35-33d7-4e0e-bcc1-047b950cc2ec req-90034077-0107-4d25-baa2-be0df3bebe96 service nova] Creating event network-vif-deleted:eae282fe-8d81-4319-ba27-6df57a7b696c for instance 62465ed7-8fe3-41fd-bc23-bafafec57cef on user Apr 20 15:21:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-ab210d35-33d7-4e0e-bcc1-047b950cc2ec req-90034077-0107-4d25-baa2-be0df3bebe96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030667 Apr 20 15:21:03 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 134/401] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:21:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:21:09 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:21:09 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] [instance: 32f44a87-50b3-449f-83dc-a7102cf727c5] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:21:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:09 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:09 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] HTTP exception thrown: Instance 32f44a87-50b3-449f-83dc-a7102cf727c5 could not be found. Apr 20 15:21:09 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Request method failure captured: Apr 20 15:21:09 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5 HTTP/1.1 Apr 20 15:21:09 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:21:09 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:21:09 user devstack@n-api.service[61508]: Connection: close Apr 20 15:21:09 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:21:09 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:21:09 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:21:09 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:21:09 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVbhpfWmId38E9X-or8YLnrefOTQ7NqgWlAyhz7gxXNlgVCzOD9GC5hflVevmR4_zDbtAjoPUWwZUbPt6-etwzb1H9bDvjLJkvyoi88No1YVWhTqvFcCYwW4JlXUCs-dnPYmM5-N9Ia0vRVsUNNSMQFCb8Y4hhR8xWA4cKfVWKx_OT8 Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Project-Id: 277c8babb24c43c6b386883035b7476c Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-468060921 Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/277c8babb24c43c6b386883035b7476c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/277c8babb24c43c6b386883035b7476c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/277c8babb24c43c6b386883035b7476c"}]}] Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Tenant: tempest-ServerRescueNegativeTestJSON-468060921 Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Tenant-Id: 277c8babb24c43c6b386883035b7476c Apr 20 15:21:09 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-468060921 Apr 20 15:21:09 user devstack@n-api.service[61508]: X-User: tempest-ServerRescueNegativeTestJSON-468060921-project-member Apr 20 15:21:09 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:21:09 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:21:09 user devstack@n-api.service[61508]: X-User-Id: cd02e13ff5394016b693bfb61c0dd244 Apr 20 15:21:09 user devstack@n-api.service[61508]: X-User-Name: tempest-ServerRescueNegativeTestJSON-468060921-project-member Apr 20 15:21:09 user devstack@n-api.service[61508]: method: > Apr 20 15:21:09 user devstack@n-api.service[61508]: exception: Instance 32f44a87-50b3-449f-83dc-a7102cf727c5 could not be found. Apr 20 15:21:09 user devstack@n-api.service[61508]: action_args: {'id': '32f44a87-50b3-449f-83dc-a7102cf727c5'} Apr 20 15:21:09 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f44a87-50b3-449f-83dc-a7102cf727c5 could not be found. Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f44a87-50b3-449f-83dc-a7102cf727c5 could not be found. Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f44a87-50b3-449f-83dc-a7102cf727c5 could not be found. Apr 20 15:21:09 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:21:09 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] Returning 404 to user: Instance 32f44a87-50b3-449f-83dc-a7102cf727c5 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:21:09 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-0a37fe8a-da2b-4809-b4e7-1845f59694a2 tempest-ServerRescueNegativeTestJSON-468060921 tempest-ServerRescueNegativeTestJSON-468060921-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5" status: 404 len: 111 microversion: 2.1 time: 0.027270 Apr 20 15:21:09 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 135/402] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:21:09 2023] GET /compute/v2.1/servers/32f44a87-50b3-449f-83dc-a7102cf727c5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=4 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:51 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] HTTP exception thrown: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Request method failure captured: Apr 20 15:21:51 user devstack@n-api.service[61509]: request: GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef HTTP/1.1 Apr 20 15:21:51 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:21:51 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:21:51 user devstack@n-api.service[61509]: Connection: close Apr 20 15:21:51 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:21:51 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:21:51 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:21:51 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:21:51 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVfoxs_XSgkFeWs2yQ4M3YdO1WZrhNGLEGCkn92J_BW9TlFm7U4wNIleWcRtb4tzUK6q5i3CM6zeA8Z3jlt7vb7UU2QDovrx4MTXlvatmSRS8Lz2eluzdXyBwjCnexkq9qfuUAkaFl5ckxTifplIV4O0AQDuIkgGEzx0BZIb7m5YPF8 Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Project-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Project-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2692d58f90a145049b98bfe08b158531"}]}] Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Tenant: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Tenant-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:21:51 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:21:51 user devstack@n-api.service[61509]: X-User: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:21:51 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:21:51 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:21:51 user devstack@n-api.service[61509]: X-User-Id: 496c0591e87641849b53fda57e1dece7 Apr 20 15:21:51 user devstack@n-api.service[61509]: X-User-Name: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:21:51 user devstack@n-api.service[61509]: method: > Apr 20 15:21:51 user devstack@n-api.service[61509]: exception: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:21:51 user devstack@n-api.service[61509]: action_args: {'id': '62465ed7-8fe3-41fd-bc23-bafafec57cef'} Apr 20 15:21:51 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:21:51 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:21:51 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Returning 404 to user: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:21:51 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-935aa2aa-06a1-40f1-b669-7154b782987d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef" status: 404 len: 111 microversion: 2.1 time: 0.049562 Apr 20 15:21:51 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 134/403] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:21:51 2023] GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:21:51 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:21:51 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:21:51 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-228bee6b-1738-4e52-8455-9874a077b570 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '.version_select at 0x7fcbb37909d0>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:21:51 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-228bee6b-1738-4e52-8455-9874a077b570 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-762607479" status: 202 len: 0 microversion: 2.1 time: 0.032860 Apr 20 15:21:51 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 135/404] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 15:21:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-762607479 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:21:51 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:21:51 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=10 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:21:51 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-f70f369c-428f-40f3-9538-39e179a50ff0 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Action: 'create', calling method: .version_select at 0x7fcbb37a72e0>, body: {"keypair": {"name": "tempest-keypair-1302894361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZT0WMTz6w9zGypvpZ7TI/sFxQvoXwRcs2GmI9smnO9QIz6JMigc06+cIOL9IwHKc0EFNQLr47H9FXjDTVJFM/yIQIc9Fa8UABE9EhXzfRtDBAOPRbtsefaNKgcPf462w=="}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:21:51 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-f70f369c-428f-40f3-9538-39e179a50ff0 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Getting quotas for project 2692d58f90a145049b98bfe08b158531. Resources: {'key_pairs'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:21:51 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-f70f369c-428f-40f3-9538-39e179a50ff0 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Getting quotas for user 496c0591e87641849b53fda57e1dece7 and project 2692d58f90a145049b98bfe08b158531. Resources: {'key_pairs'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:21:51 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-f70f369c-428f-40f3-9538-39e179a50ff0 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057235 Apr 20 15:21:51 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 136/405] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:21:51 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:21:53 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1479142996", "imageRef": "a3ef29bc-488e-4b66-9911-ce34d9967f31", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "79555824-7b3f-4ed2-b076-92c2ebdf36b9"}], "security_groups": [{"name": "tempest-securitygroup--247586634"}], "key_name": "tempest-keypair-1302894361", "user_data": "}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:21:53 user devstack@n-api.service[61509]: DEBUG nova.network.neutron [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] validate_networks() for [('79555824-7b3f-4ed2-b076-92c2ebdf36b9', None, None, None, None, None)] {{(pid=61509) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Flavor limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Image limits 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Flavor pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Image pref 0:0:0 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG nova.virt.hardware [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Getting quotas for project 2692d58f90a145049b98bfe08b158531. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Getting quotas for user 496c0591e87641849b53fda57e1dece7 and project 2692d58f90a145049b98bfe08b158531. Resources: {'ram', 'instances', 'cores'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Going to run 1 instances... {{(pid=61509) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:21:54 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ef29bc-488e-4b66-9911-ce34d9967f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:21:54 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-2bc9022f-3dcf-465f-b27c-8e034ca8adbc tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.971126 Apr 20 15:21:54 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 135/406] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:21:53 2023] POST /compute/v2.1/servers => generated 399 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:21:54 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-d14f34e5-234b-4468-b11d-4686e0326342 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:21:54 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-d14f34e5-234b-4468-b11d-4686e0326342 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:21:54 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-d14f34e5-234b-4468-b11d-4686e0326342 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496c0591e87641849b53fda57e1dece7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2692d58f90a145049b98bfe08b158531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:21:54 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-d14f34e5-234b-4468-b11d-4686e0326342 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36" status: 200 len: 1232 microversion: 2.1 time: 0.069535 Apr 20 15:21:54 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 136/407] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:21:54 2023] GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 => generated 1232 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:21:56 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-3ee278f7-dcb8-4ebc-86ce-bf32984f85ef req-0b2f07c5-cee8-4acb-8dfb-9e00c50820d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a66a47-f734-4599-ac56-c8575f308e36", "tag": "6213b6bb-fdeb-4b9f-960b-ec891ca6dc15"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:21:56 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-3ee278f7-dcb8-4ebc-86ce-bf32984f85ef req-0b2f07c5-cee8-4acb-8dfb-9e00c50820d2 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:56 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-3ee278f7-dcb8-4ebc-86ce-bf32984f85ef req-0b2f07c5-cee8-4acb-8dfb-9e00c50820d2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:56 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-3ee278f7-dcb8-4ebc-86ce-bf32984f85ef req-0b2f07c5-cee8-4acb-8dfb-9e00c50820d2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:56 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-3ee278f7-dcb8-4ebc-86ce-bf32984f85ef req-0b2f07c5-cee8-4acb-8dfb-9e00c50820d2 service nova] Creating event network-changed:6213b6bb-fdeb-4b9f-960b-ec891ca6dc15 for instance 41a66a47-f734-4599-ac56-c8575f308e36 on user Apr 20 15:21:56 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-3ee278f7-dcb8-4ebc-86ce-bf32984f85ef req-0b2f07c5-cee8-4acb-8dfb-9e00c50820d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031170 Apr 20 15:21:56 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 137/408] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:21:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:21:58 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-991f0b49-3252-47ab-a064-52867aba7f15 req-1e1679be-17bf-4a9e-bfe2-8e7bc8d88ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a66a47-f734-4599-ac56-c8575f308e36", "name": "network-vif-plugged", "status": "completed", "tag": "6213b6bb-fdeb-4b9f-960b-ec891ca6dc15"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:21:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-991f0b49-3252-47ab-a064-52867aba7f15 req-1e1679be-17bf-4a9e-bfe2-8e7bc8d88ed4 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:21:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-991f0b49-3252-47ab-a064-52867aba7f15 req-1e1679be-17bf-4a9e-bfe2-8e7bc8d88ed4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:21:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-991f0b49-3252-47ab-a064-52867aba7f15 req-1e1679be-17bf-4a9e-bfe2-8e7bc8d88ed4 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:21:58 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-991f0b49-3252-47ab-a064-52867aba7f15 req-1e1679be-17bf-4a9e-bfe2-8e7bc8d88ed4 service nova] Creating event network-vif-plugged:6213b6bb-fdeb-4b9f-960b-ec891ca6dc15 for instance 41a66a47-f734-4599-ac56-c8575f308e36 on user Apr 20 15:21:58 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-991f0b49-3252-47ab-a064-52867aba7f15 req-1e1679be-17bf-4a9e-bfe2-8e7bc8d88ed4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036985 Apr 20 15:21:58 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 136/409] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:21:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:22:00 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-28482819-e1ae-488c-a9f0-cda0d394831e req-a87e82ee-4bbb-4ccf-af0b-db20b8f924c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a66a47-f734-4599-ac56-c8575f308e36", "name": "network-vif-plugged", "status": "completed", "tag": "6213b6bb-fdeb-4b9f-960b-ec891ca6dc15"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:22:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-28482819-e1ae-488c-a9f0-cda0d394831e req-a87e82ee-4bbb-4ccf-af0b-db20b8f924c5 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:22:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-28482819-e1ae-488c-a9f0-cda0d394831e req-a87e82ee-4bbb-4ccf-af0b-db20b8f924c5 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:22:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-28482819-e1ae-488c-a9f0-cda0d394831e req-a87e82ee-4bbb-4ccf-af0b-db20b8f924c5 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:22:00 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-28482819-e1ae-488c-a9f0-cda0d394831e req-a87e82ee-4bbb-4ccf-af0b-db20b8f924c5 service nova] Creating event network-vif-plugged:6213b6bb-fdeb-4b9f-960b-ec891ca6dc15 for instance 41a66a47-f734-4599-ac56-c8575f308e36 on user Apr 20 15:22:00 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-28482819-e1ae-488c-a9f0-cda0d394831e req-a87e82ee-4bbb-4ccf-af0b-db20b8f924c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027952 Apr 20 15:22:00 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 137/410] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-dc36c4fc-1b7f-4f44-8c33-3027214757a6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-dc36c4fc-1b7f-4f44-8c33-3027214757a6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-dc36c4fc-1b7f-4f44-8c33-3027214757a6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-dc36c4fc-1b7f-4f44-8c33-3027214757a6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-dc36c4fc-1b7f-4f44-8c33-3027214757a6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-dc36c4fc-1b7f-4f44-8c33-3027214757a6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-dc36c4fc-1b7f-4f44-8c33-3027214757a6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-dc36c4fc-1b7f-4f44-8c33-3027214757a6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:22:44 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-dc36c4fc-1b7f-4f44-8c33-3027214757a6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496c0591e87641849b53fda57e1dece7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2692d58f90a145049b98bfe08b158531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:22:44 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-dc36c4fc-1b7f-4f44-8c33-3027214757a6 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36" status: 200 len: 1537 microversion: 2.1 time: 0.234568 Apr 20 15:22:44 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 138/411] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:22:44 2023] GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 => generated 1537 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:23:44 user devstack@n-api.service[61509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 15:23:44 user devstack@n-api.service[61509]: Thu Apr 20 15:23:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36/os-interface (ip 10.0.0.210) !!! Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-daffbadf-e422-4440-8642-9b3ac9f1411b tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-daffbadf-e422-4440-8642-9b3ac9f1411b tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-daffbadf-e422-4440-8642-9b3ac9f1411b tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-daffbadf-e422-4440-8642-9b3ac9f1411b tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-daffbadf-e422-4440-8642-9b3ac9f1411b tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-daffbadf-e422-4440-8642-9b3ac9f1411b tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-daffbadf-e422-4440-8642-9b3ac9f1411b tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-daffbadf-e422-4440-8642-9b3ac9f1411b tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:45 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-daffbadf-e422-4440-8642-9b3ac9f1411b tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.181354 Apr 20 15:23:45 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 137/412] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 15:23:44 2023] GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36/os-interface => generated 282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:23:45 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:23:45 user devstack@n-api.service[61510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 15:23:45 user devstack@n-api.service[61510]: Thu Apr 20 15:23:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 20 15:23:45 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:23:45 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:23:45 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-f46502e8-fb3f-43da-ba06-cf3e868ec63a req-abf7ed08-2765-476b-aab3-d68c5be6fb27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a66a47-f734-4599-ac56-c8575f308e36", "tag": "6213b6bb-fdeb-4b9f-960b-ec891ca6dc15"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:23:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f46502e8-fb3f-43da-ba06-cf3e868ec63a req-abf7ed08-2765-476b-aab3-d68c5be6fb27 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f46502e8-fb3f-43da-ba06-cf3e868ec63a req-abf7ed08-2765-476b-aab3-d68c5be6fb27 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-f46502e8-fb3f-43da-ba06-cf3e868ec63a req-abf7ed08-2765-476b-aab3-d68c5be6fb27 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:45 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:23:45 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:23:45 user devstack@n-api.service[61508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 15:23:45 user devstack@n-api.service[61508]: Thu Apr 20 15:23:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36/ips (ip 10.0.0.210) !!! Apr 20 15:23:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-f46502e8-fb3f-43da-ba06-cf3e868ec63a req-abf7ed08-2765-476b-aab3-d68c5be6fb27 service nova] Creating event network-changed:6213b6bb-fdeb-4b9f-960b-ec891ca6dc15 for instance 41a66a47-f734-4599-ac56-c8575f308e36 on user Apr 20 15:23:45 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-29b727d3-e2c1-416f-9f97-913f9e96f3d9 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:23:45 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-29b727d3-e2c1-416f-9f97-913f9e96f3d9 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:23:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-f46502e8-fb3f-43da-ba06-cf3e868ec63a req-abf7ed08-2765-476b-aab3-d68c5be6fb27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042189 Apr 20 15:23:45 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 138/413] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:23:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:23:45 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29b727d3-e2c1-416f-9f97-913f9e96f3d9 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:45 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29b727d3-e2c1-416f-9f97-913f9e96f3d9 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:45 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29b727d3-e2c1-416f-9f97-913f9e96f3d9 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:45 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29b727d3-e2c1-416f-9f97-913f9e96f3d9 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:45 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29b727d3-e2c1-416f-9f97-913f9e96f3d9 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:45 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-29b727d3-e2c1-416f-9f97-913f9e96f3d9 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:46 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-29b727d3-e2c1-416f-9f97-913f9e96f3d9 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36/ips" status: 200 len: 104 microversion: 2.1 time: 0.048429 Apr 20 15:23:46 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 139/414] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 15:23:45 2023] GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36/ips => generated 104 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:23:47 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-8625f4a7-f81b-4cc8-9609-186e03af9540 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:23:47 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-8625f4a7-f81b-4cc8-9609-186e03af9540 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:23:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8625f4a7-f81b-4cc8-9609-186e03af9540 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8625f4a7-f81b-4cc8-9609-186e03af9540 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8625f4a7-f81b-4cc8-9609-186e03af9540 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8625f4a7-f81b-4cc8-9609-186e03af9540 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8625f4a7-f81b-4cc8-9609-186e03af9540 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:47 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-8625f4a7-f81b-4cc8-9609-186e03af9540 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:47 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-8625f4a7-f81b-4cc8-9609-186e03af9540 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] Going to try to terminate instance {{(pid=61509) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:23:47 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-8625f4a7-f81b-4cc8-9609-186e03af9540 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36" status: 204 len: 0 microversion: 2.1 time: 0.120908 Apr 20 15:23:47 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 138/415] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:23:47 2023] DELETE /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:23:47 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-feed52b3-b2d2-4849-a3bf-83a36ef6b029 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:23:47 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-feed52b3-b2d2-4849-a3bf-83a36ef6b029 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:23:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-feed52b3-b2d2-4849-a3bf-83a36ef6b029 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-feed52b3-b2d2-4849-a3bf-83a36ef6b029 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-feed52b3-b2d2-4849-a3bf-83a36ef6b029 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-feed52b3-b2d2-4849-a3bf-83a36ef6b029 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-feed52b3-b2d2-4849-a3bf-83a36ef6b029 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-feed52b3-b2d2-4849-a3bf-83a36ef6b029 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:47 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-a2607330-4787-43d4-a462-5cce699f0ba7 req-3fbee526-6ead-4be4-bfe3-f124844a0ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a66a47-f734-4599-ac56-c8575f308e36", "name": "network-vif-unplugged", "status": "completed", "tag": "6213b6bb-fdeb-4b9f-960b-ec891ca6dc15"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:23:47 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-a2607330-4787-43d4-a462-5cce699f0ba7 req-3fbee526-6ead-4be4-bfe3-f124844a0ec9 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:47 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-a2607330-4787-43d4-a462-5cce699f0ba7 req-3fbee526-6ead-4be4-bfe3-f124844a0ec9 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:47 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-a2607330-4787-43d4-a462-5cce699f0ba7 req-3fbee526-6ead-4be4-bfe3-f124844a0ec9 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:47 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-a2607330-4787-43d4-a462-5cce699f0ba7 req-3fbee526-6ead-4be4-bfe3-f124844a0ec9 service nova] Creating event network-vif-unplugged:6213b6bb-fdeb-4b9f-960b-ec891ca6dc15 for instance 41a66a47-f734-4599-ac56-c8575f308e36 on user Apr 20 15:23:47 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-a2607330-4787-43d4-a462-5cce699f0ba7 req-3fbee526-6ead-4be4-bfe3-f124844a0ec9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028319 Apr 20 15:23:47 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 140/416] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:23:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:23:47 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-feed52b3-b2d2-4849-a3bf-83a36ef6b029 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496c0591e87641849b53fda57e1dece7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2692d58f90a145049b98bfe08b158531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:23:48 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-feed52b3-b2d2-4849-a3bf-83a36ef6b029 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36" status: 200 len: 1661 microversion: 2.1 time: 0.503908 Apr 20 15:23:48 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 139/417] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:23:47 2023] GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 => generated 1661 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:23:49 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-b0ef3af9-5cca-4a3d-bcc5-287aa8dcf496 req-b3dfd730-b9e5-4ab2-b82b-eaf47bd49d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a66a47-f734-4599-ac56-c8575f308e36", "name": "network-vif-plugged", "status": "completed", "tag": "6213b6bb-fdeb-4b9f-960b-ec891ca6dc15"}, {"server_uuid": "41a66a47-f734-4599-ac56-c8575f308e36", "name": "network-vif-deleted", "tag": "6213b6bb-fdeb-4b9f-960b-ec891ca6dc15"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:23:49 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-b0ef3af9-5cca-4a3d-bcc5-287aa8dcf496 req-b3dfd730-b9e5-4ab2-b82b-eaf47bd49d76 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:23:49 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-b0ef3af9-5cca-4a3d-bcc5-287aa8dcf496 req-b3dfd730-b9e5-4ab2-b82b-eaf47bd49d76 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:23:49 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-b0ef3af9-5cca-4a3d-bcc5-287aa8dcf496 req-b3dfd730-b9e5-4ab2-b82b-eaf47bd49d76 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:23:49 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-b0ef3af9-5cca-4a3d-bcc5-287aa8dcf496 req-b3dfd730-b9e5-4ab2-b82b-eaf47bd49d76 service nova] Creating event network-vif-plugged:6213b6bb-fdeb-4b9f-960b-ec891ca6dc15 for instance 41a66a47-f734-4599-ac56-c8575f308e36 on user Apr 20 15:23:49 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-b0ef3af9-5cca-4a3d-bcc5-287aa8dcf496 req-b3dfd730-b9e5-4ab2-b82b-eaf47bd49d76 service nova] Creating event network-vif-deleted:6213b6bb-fdeb-4b9f-960b-ec891ca6dc15 for instance 41a66a47-f734-4599-ac56-c8575f308e36 on user Apr 20 15:23:49 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-b0ef3af9-5cca-4a3d-bcc5-287aa8dcf496 req-b3dfd730-b9e5-4ab2-b82b-eaf47bd49d76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044767 Apr 20 15:23:49 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 139/418] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:23:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:24:38 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] HTTP exception thrown: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Request method failure captured: Apr 20 15:24:38 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 HTTP/1.1 Apr 20 15:24:38 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:24:38 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:24:38 user devstack@n-api.service[61508]: Connection: close Apr 20 15:24:38 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:24:38 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:24:38 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:24:38 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:24:38 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVfoxs_XSgkFeWs2yQ4M3YdO1WZrhNGLEGCkn92J_BW9TlFm7U4wNIleWcRtb4tzUK6q5i3CM6zeA8Z3jlt7vb7UU2QDovrx4MTXlvatmSRS8Lz2eluzdXyBwjCnexkq9qfuUAkaFl5ckxTifplIV4O0AQDuIkgGEzx0BZIb7m5YPF8 Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Project-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Project-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2692d58f90a145049b98bfe08b158531"}]}] Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Tenant: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Tenant-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:24:38 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:38 user devstack@n-api.service[61508]: X-User: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:24:38 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:24:38 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:24:38 user devstack@n-api.service[61508]: X-User-Id: 496c0591e87641849b53fda57e1dece7 Apr 20 15:24:38 user devstack@n-api.service[61508]: X-User-Name: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:24:38 user devstack@n-api.service[61508]: method: > Apr 20 15:24:38 user devstack@n-api.service[61508]: exception: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:38 user devstack@n-api.service[61508]: action_args: {'id': '41a66a47-f734-4599-ac56-c8575f308e36'} Apr 20 15:24:38 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:38 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:24:38 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Returning 404 to user: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:24:38 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-e9d954f8-f3f1-4d3d-a8ff-c15f98af9b85 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36" status: 404 len: 111 microversion: 2.1 time: 0.117625 Apr 20 15:24:38 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 141/419] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:24:38 2023] GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:24:38 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-fc80999c-2e3d-4cf2-a608-6bae25c4ab98 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '.version_select at 0x7fcbb369cca0>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:24:38 user devstack@n-api.service[61510]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc80999c-2e3d-4cf2-a608-6bae25c4ab98 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [dc1cc51f-6ee5-485c-b668-6c3c21f1fc3b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 20 15:24:38 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:24:38 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=8 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:24:39 user devstack@n-api.service[61510]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc80999c-2e3d-4cf2-a608-6bae25c4ab98 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [dc1cc51f-6ee5-485c-b668-6c3c21f1fc3b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 45636. Apr 20 15:24:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-fc80999c-2e3d-4cf2-a608-6bae25c4ab98 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302894361" status: 202 len: 0 microversion: 2.1 time: 1.034415 Apr 20 15:24:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 140/420] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 15:24:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302894361 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:24:40 user devstack@n-api.service[61509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 15:24:40 user devstack@n-api.service[61509]: Thu Apr 20 15:24:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 (ip 10.0.0.210) !!! Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:24:40 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] HTTP exception thrown: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Request method failure captured: Apr 20 15:24:40 user devstack@n-api.service[61509]: request: DELETE /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 HTTP/1.1 Apr 20 15:24:40 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:24:40 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:24:40 user devstack@n-api.service[61509]: Connection: close Apr 20 15:24:40 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:24:40 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:24:40 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:24:40 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:24:40 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVfoxs_XSgkFeWs2yQ4M3YdO1WZrhNGLEGCkn92J_BW9TlFm7U4wNIleWcRtb4tzUK6q5i3CM6zeA8Z3jlt7vb7UU2QDovrx4MTXlvatmSRS8Lz2eluzdXyBwjCnexkq9qfuUAkaFl5ckxTifplIV4O0AQDuIkgGEzx0BZIb7m5YPF8 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Project-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Project-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2692d58f90a145049b98bfe08b158531"}]}] Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Tenant: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Tenant-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-User: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:24:40 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:24:40 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:24:40 user devstack@n-api.service[61509]: X-User-Id: 496c0591e87641849b53fda57e1dece7 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-User-Name: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:24:40 user devstack@n-api.service[61509]: method: > Apr 20 15:24:40 user devstack@n-api.service[61509]: exception: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:40 user devstack@n-api.service[61509]: action_args: {'id': '41a66a47-f734-4599-ac56-c8575f308e36'} Apr 20 15:24:40 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Returning 404 to user: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:24:40 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-95c76a8a-b6cf-47b4-8673-0f90f9d31b23 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36" status: 404 len: 111 microversion: 2.1 time: 0.046827 Apr 20 15:24:40 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 140/421] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:24:40 2023] DELETE /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:24:40 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:24:40 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 41a66a47-f734-4599-ac56-c8575f308e36] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:24:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:24:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:24:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:24:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:24:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:24:40 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:24:40 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] HTTP exception thrown: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:40 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Request method failure captured: Apr 20 15:24:40 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 HTTP/1.1 Apr 20 15:24:40 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:24:40 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:24:40 user devstack@n-api.service[61508]: Connection: close Apr 20 15:24:40 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:24:40 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:24:40 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:24:40 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:24:40 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVfoxs_XSgkFeWs2yQ4M3YdO1WZrhNGLEGCkn92J_BW9TlFm7U4wNIleWcRtb4tzUK6q5i3CM6zeA8Z3jlt7vb7UU2QDovrx4MTXlvatmSRS8Lz2eluzdXyBwjCnexkq9qfuUAkaFl5ckxTifplIV4O0AQDuIkgGEzx0BZIb7m5YPF8 Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Project-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Project-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2692d58f90a145049b98bfe08b158531"}]}] Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Tenant: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Tenant-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:24:40 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61508]: X-User: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:24:40 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:24:40 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:24:40 user devstack@n-api.service[61508]: X-User-Id: 496c0591e87641849b53fda57e1dece7 Apr 20 15:24:40 user devstack@n-api.service[61508]: X-User-Name: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:24:40 user devstack@n-api.service[61508]: method: > Apr 20 15:24:40 user devstack@n-api.service[61508]: exception: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:40 user devstack@n-api.service[61508]: action_args: {'id': '41a66a47-f734-4599-ac56-c8575f308e36'} Apr 20 15:24:40 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. Apr 20 15:24:40 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Returning 404 to user: Instance 41a66a47-f734-4599-ac56-c8575f308e36 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:24:40 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-5d56ff92-17c8-47cb-8c7a-898242d9e79d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36" status: 404 len: 111 microversion: 2.1 time: 0.030225 Apr 20 15:24:40 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 142/422] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:24:40 2023] GET /compute/v2.1/servers/41a66a47-f734-4599-ac56-c8575f308e36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:24:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:24:40 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:24:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:24:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:24:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:24:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:24:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:24:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:24:40 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] HTTP exception thrown: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:24:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Request method failure captured: Apr 20 15:24:40 user devstack@n-api.service[61510]: request: DELETE /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef HTTP/1.1 Apr 20 15:24:40 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:24:40 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:24:40 user devstack@n-api.service[61510]: Connection: close Apr 20 15:24:40 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:24:40 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:24:40 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:24:40 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:24:40 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVfoxs_XSgkFeWs2yQ4M3YdO1WZrhNGLEGCkn92J_BW9TlFm7U4wNIleWcRtb4tzUK6q5i3CM6zeA8Z3jlt7vb7UU2QDovrx4MTXlvatmSRS8Lz2eluzdXyBwjCnexkq9qfuUAkaFl5ckxTifplIV4O0AQDuIkgGEzx0BZIb7m5YPF8 Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Project-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2692d58f90a145049b98bfe08b158531"}]}] Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Tenant-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:24:40 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:24:40 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:24:40 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:24:40 user devstack@n-api.service[61510]: X-User-Id: 496c0591e87641849b53fda57e1dece7 Apr 20 15:24:40 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:24:40 user devstack@n-api.service[61510]: method: > Apr 20 15:24:40 user devstack@n-api.service[61510]: exception: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:24:40 user devstack@n-api.service[61510]: action_args: {'id': '62465ed7-8fe3-41fd-bc23-bafafec57cef'} Apr 20 15:24:40 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:24:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Returning 404 to user: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:24:40 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b1b9a520-281d-4367-9d49-613dffae925d tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef" status: 404 len: 111 microversion: 2.1 time: 0.033401 Apr 20 15:24:40 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 141/423] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:24:40 2023] DELETE /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] [instance: 62465ed7-8fe3-41fd-bc23-bafafec57cef] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:24:40 user devstack@n-api.service[61509]: INFO nova.api.openstack.wsgi [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] HTTP exception thrown: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Request method failure captured: Apr 20 15:24:40 user devstack@n-api.service[61509]: request: GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef HTTP/1.1 Apr 20 15:24:40 user devstack@n-api.service[61509]: Accept: application/json Apr 20 15:24:40 user devstack@n-api.service[61509]: Accept-Encoding: identity Apr 20 15:24:40 user devstack@n-api.service[61509]: Connection: close Apr 20 15:24:40 user devstack@n-api.service[61509]: Content-Length: 0 Apr 20 15:24:40 user devstack@n-api.service[61509]: Content-Type: application/json Apr 20 15:24:40 user devstack@n-api.service[61509]: Host: 10.0.0.210 Apr 20 15:24:40 user devstack@n-api.service[61509]: Openstack-System-Scope: None Apr 20 15:24:40 user devstack@n-api.service[61509]: User-Agent: python-urllib3/1.26.15 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Auth-Token: gAAAAABkQVfoxs_XSgkFeWs2yQ4M3YdO1WZrhNGLEGCkn92J_BW9TlFm7U4wNIleWcRtb4tzUK6q5i3CM6zeA8Z3jlt7vb7UU2QDovrx4MTXlvatmSRS8Lz2eluzdXyBwjCnexkq9qfuUAkaFl5ckxTifplIV4O0AQDuIkgGEzx0BZIb7m5YPF8 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Domain-Id: None Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Domain-Name: None Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Identity-Status: Confirmed Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Is-Admin-Project: True Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Project-Domain-Id: default Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Project-Domain-Name: Default Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Project-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Project-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Role: member,reader Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Roles: member,reader Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2692d58f90a145049b98bfe08b158531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2692d58f90a145049b98bfe08b158531"}]}] Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Tenant: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Tenant-Id: 2692d58f90a145049b98bfe08b158531 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-467600022 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-User: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:24:40 user devstack@n-api.service[61509]: X-User-Domain-Id: default Apr 20 15:24:40 user devstack@n-api.service[61509]: X-User-Domain-Name: Default Apr 20 15:24:40 user devstack@n-api.service[61509]: X-User-Id: 496c0591e87641849b53fda57e1dece7 Apr 20 15:24:40 user devstack@n-api.service[61509]: X-User-Name: tempest-AttachVolumeTestJSON-467600022-project-member Apr 20 15:24:40 user devstack@n-api.service[61509]: method: > Apr 20 15:24:40 user devstack@n-api.service[61509]: exception: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:24:40 user devstack@n-api.service[61509]: action_args: {'id': '62465ed7-8fe3-41fd-bc23-bafafec57cef'} Apr 20 15:24:40 user devstack@n-api.service[61509]: {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. Apr 20 15:24:40 user devstack@n-api.service[61509]: ERROR nova.api.openstack.wsgi Apr 20 15:24:40 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] Returning 404 to user: Instance 62465ed7-8fe3-41fd-bc23-bafafec57cef could not be found. {{(pid=61509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:24:40 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-3f7008ea-68b5-4400-ac98-3fb64ac08874 tempest-AttachVolumeTestJSON-467600022 tempest-AttachVolumeTestJSON-467600022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef" status: 404 len: 111 microversion: 2.1 time: 0.031466 Apr 20 15:24:40 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 141/424] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:24:40 2023] GET /compute/v2.1/servers/62465ed7-8fe3-41fd-bc23-bafafec57cef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:25:06 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-7cc5749f-4c2e-4d8d-aa7e-104317ac014e tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Action: 'create', calling method: .version_select at 0x7fcbb37a5d80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2032337917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu1zhshKNNWP01kwJ3t6/1kxGPzRaQcWr0re5y5zQyVX3b6/MtkP3JHYAXlrWUkvl0r8PYxF5Aaikxcl/5n/bqbwHmG+tvpdr5Osr7LkyDaEsugvx4rpunncm4v7zuBTw=="}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:25:06 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:25:06 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:25:06 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-7cc5749f-4c2e-4d8d-aa7e-104317ac014e tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Getting quotas for project e915a3fd15f94d6e960eb0d61d87914c. Resources: {'key_pairs'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:25:06 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-7cc5749f-4c2e-4d8d-aa7e-104317ac014e tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Getting quotas for user 9923613608ba4dccbefc5981204fc5b3 and project e915a3fd15f94d6e960eb0d61d87914c. Resources: {'key_pairs'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:25:06 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-7cc5749f-4c2e-4d8d-aa7e-104317ac014e tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047745 Apr 20 15:25:06 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 143/425] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:25:06 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:25:06 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1584660005", "imageRef": "93a51159-055b-4365-a58f-eea5f417641b", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-2032337917", "networks": [{"uuid": "360d0501-d79a-4ffb-be7e-ba247ac7c8f0"}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:25:06 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:25:06 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:25:06 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] validate_networks() for [('360d0501-d79a-4ffb-be7e-ba247ac7c8f0', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Getting quotas for project e915a3fd15f94d6e960eb0d61d87914c. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Getting quotas for user 9923613608ba4dccbefc5981204fc5b3 and project e915a3fd15f94d6e960eb0d61d87914c. Resources: {'ram', 'instances', 'cores'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:25:07 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: c0f42aa4-6873-4be0-8a22-139180fa0061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93a51159-055b-4365-a58f-eea5f417641b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:25:07 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-e33219c3-a4c5-4d9e-87ee-ae899b23d41c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.690567 Apr 20 15:25:07 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 142/426] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:25:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:25:07 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-cb1f213c-deef-49fd-899b-e52d46e57c5c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:25:07 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-cb1f213c-deef-49fd-899b-e52d46e57c5c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: c0f42aa4-6873-4be0-8a22-139180fa0061] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:25:07 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=4 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:25:07 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=4 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:25:07 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-cb1f213c-deef-49fd-899b-e52d46e57c5c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:25:07 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-cb1f213c-deef-49fd-899b-e52d46e57c5c tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061" status: 200 len: 1253 microversion: 2.1 time: 0.186007 Apr 20 15:25:07 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 142/427] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:25:07 2023] GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061 => generated 1253 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:25:10 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-9f371f21-f6d3-4002-825f-1f1203bff9a1 req-00ca1232-b172-45b6-a875-9386a46d53bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f42aa4-6873-4be0-8a22-139180fa0061", "tag": "6a572ad2-b3ff-42d0-91e5-b7f03df5da2f"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:25:10 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-9f371f21-f6d3-4002-825f-1f1203bff9a1 req-00ca1232-b172-45b6-a875-9386a46d53bd service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:25:10 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-9f371f21-f6d3-4002-825f-1f1203bff9a1 req-00ca1232-b172-45b6-a875-9386a46d53bd service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:25:10 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-9f371f21-f6d3-4002-825f-1f1203bff9a1 req-00ca1232-b172-45b6-a875-9386a46d53bd service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:25:10 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-9f371f21-f6d3-4002-825f-1f1203bff9a1 req-00ca1232-b172-45b6-a875-9386a46d53bd service nova] Creating event network-changed:6a572ad2-b3ff-42d0-91e5-b7f03df5da2f for instance c0f42aa4-6873-4be0-8a22-139180fa0061 on user Apr 20 15:25:10 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-9f371f21-f6d3-4002-825f-1f1203bff9a1 req-00ca1232-b172-45b6-a875-9386a46d53bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050434 Apr 20 15:25:10 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 144/428] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:25:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:25:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-88212a40-95db-4c01-a850-5d91c8639ee7 req-87e42e16-b403-418c-a0fb-088bc19481f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f42aa4-6873-4be0-8a22-139180fa0061", "name": "network-vif-plugged", "status": "completed", "tag": "6a572ad2-b3ff-42d0-91e5-b7f03df5da2f"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:25:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-88212a40-95db-4c01-a850-5d91c8639ee7 req-87e42e16-b403-418c-a0fb-088bc19481f8 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:25:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-88212a40-95db-4c01-a850-5d91c8639ee7 req-87e42e16-b403-418c-a0fb-088bc19481f8 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:25:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-88212a40-95db-4c01-a850-5d91c8639ee7 req-87e42e16-b403-418c-a0fb-088bc19481f8 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:25:12 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-88212a40-95db-4c01-a850-5d91c8639ee7 req-87e42e16-b403-418c-a0fb-088bc19481f8 service nova] Creating event network-vif-plugged:6a572ad2-b3ff-42d0-91e5-b7f03df5da2f for instance c0f42aa4-6873-4be0-8a22-139180fa0061 on user Apr 20 15:25:12 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-88212a40-95db-4c01-a850-5d91c8639ee7 req-87e42e16-b403-418c-a0fb-088bc19481f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107495 Apr 20 15:25:12 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 143/429] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:25:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:25:14 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-7e16a736-7bb2-4cf3-822a-fabf3e9c57c1 req-c5493a1f-785c-4ed4-80c9-7baaae45c1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f42aa4-6873-4be0-8a22-139180fa0061", "name": "network-vif-plugged", "status": "completed", "tag": "6a572ad2-b3ff-42d0-91e5-b7f03df5da2f"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:25:14 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-7e16a736-7bb2-4cf3-822a-fabf3e9c57c1 req-c5493a1f-785c-4ed4-80c9-7baaae45c1a2 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:25:14 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-7e16a736-7bb2-4cf3-822a-fabf3e9c57c1 req-c5493a1f-785c-4ed4-80c9-7baaae45c1a2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:25:14 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-7e16a736-7bb2-4cf3-822a-fabf3e9c57c1 req-c5493a1f-785c-4ed4-80c9-7baaae45c1a2 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:25:14 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-7e16a736-7bb2-4cf3-822a-fabf3e9c57c1 req-c5493a1f-785c-4ed4-80c9-7baaae45c1a2 service nova] Creating event network-vif-plugged:6a572ad2-b3ff-42d0-91e5-b7f03df5da2f for instance c0f42aa4-6873-4be0-8a22-139180fa0061 on user Apr 20 15:25:14 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-7e16a736-7bb2-4cf3-822a-fabf3e9c57c1 req-c5493a1f-785c-4ed4-80c9-7baaae45c1a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030859 Apr 20 15:25:14 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 143/430] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:25:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-18393c32-2d0d-4202-914d-64bca61dab3f tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-18393c32-2d0d-4202-914d-64bca61dab3f tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: c0f42aa4-6873-4be0-8a22-139180fa0061] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-18393c32-2d0d-4202-914d-64bca61dab3f tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-18393c32-2d0d-4202-914d-64bca61dab3f tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-18393c32-2d0d-4202-914d-64bca61dab3f tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-18393c32-2d0d-4202-914d-64bca61dab3f tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-18393c32-2d0d-4202-914d-64bca61dab3f tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:25:57 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-18393c32-2d0d-4202-914d-64bca61dab3f tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:25:58 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-18393c32-2d0d-4202-914d-64bca61dab3f tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:25:58 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-18393c32-2d0d-4202-914d-64bca61dab3f tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061" status: 200 len: 1537 microversion: 2.1 time: 0.280367 Apr 20 15:25:58 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 145/431] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:25:57 2023] GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061 => generated 1537 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-a4c4f66a-7ae2-4493-8bd4-0b0675768c59 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-a4c4f66a-7ae2-4493-8bd4-0b0675768c59 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: c0f42aa4-6873-4be0-8a22-139180fa0061] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a4c4f66a-7ae2-4493-8bd4-0b0675768c59 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a4c4f66a-7ae2-4493-8bd4-0b0675768c59 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a4c4f66a-7ae2-4493-8bd4-0b0675768c59 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a4c4f66a-7ae2-4493-8bd4-0b0675768c59 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a4c4f66a-7ae2-4493-8bd4-0b0675768c59 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a4c4f66a-7ae2-4493-8bd4-0b0675768c59 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:26:58 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-a4c4f66a-7ae2-4493-8bd4-0b0675768c59 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:26:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-a4c4f66a-7ae2-4493-8bd4-0b0675768c59 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061" status: 200 len: 1537 microversion: 2.1 time: 0.254420 Apr 20 15:26:58 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 144/432] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:26:58 2023] GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061 => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:26:58 user devstack@n-api.service[61509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 15:26:58 user devstack@n-api.service[61509]: Thu Apr 20 15:26:58 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Searching by: {'deleted': False, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c'} {{(pid=61509) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:26:58 user devstack@n-api.service[61509]: DEBUG nova.compute.multi_cell_list [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61509) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 15:26:58 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-ddf0b2c2-7be7-47df-970b-bacbafd7aac3 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.210997 Apr 20 15:26:58 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 144/433] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 15:26:58 2023] GET /compute/v2.1/servers => generated 341 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-30b41752-7bb8-4e1a-b1ed-c4cd1ea78bef tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-30b41752-7bb8-4e1a-b1ed-c4cd1ea78bef tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: c0f42aa4-6873-4be0-8a22-139180fa0061] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-30b41752-7bb8-4e1a-b1ed-c4cd1ea78bef tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-30b41752-7bb8-4e1a-b1ed-c4cd1ea78bef tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-30b41752-7bb8-4e1a-b1ed-c4cd1ea78bef tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-30b41752-7bb8-4e1a-b1ed-c4cd1ea78bef tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-30b41752-7bb8-4e1a-b1ed-c4cd1ea78bef tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-30b41752-7bb8-4e1a-b1ed-c4cd1ea78bef tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:26:58 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-30b41752-7bb8-4e1a-b1ed-c4cd1ea78bef tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:26:58 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-30b41752-7bb8-4e1a-b1ed-c4cd1ea78bef tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061" status: 200 len: 1537 microversion: 2.1 time: 0.237107 Apr 20 15:26:58 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 146/434] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:26:58 2023] GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:27:00 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-518366e8-8212-434b-bf32-e4a9c83c3c7d tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:27:00 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-518366e8-8212-434b-bf32-e4a9c83c3c7d tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: c0f42aa4-6873-4be0-8a22-139180fa0061] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:27:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-518366e8-8212-434b-bf32-e4a9c83c3c7d tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-518366e8-8212-434b-bf32-e4a9c83c3c7d tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-518366e8-8212-434b-bf32-e4a9c83c3c7d tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-518366e8-8212-434b-bf32-e4a9c83c3c7d tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-518366e8-8212-434b-bf32-e4a9c83c3c7d tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-518366e8-8212-434b-bf32-e4a9c83c3c7d tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:00 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-518366e8-8212-434b-bf32-e4a9c83c3c7d tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: c0f42aa4-6873-4be0-8a22-139180fa0061] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:27:00 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-518366e8-8212-434b-bf32-e4a9c83c3c7d tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061" status: 204 len: 0 microversion: 2.1 time: 0.116061 Apr 20 15:27:00 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 145/435] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:27:00 2023] DELETE /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:27:00 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-97b7a4cd-2e16-4f0f-b2eb-b8ae318b2bb7 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:27:00 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-97b7a4cd-2e16-4f0f-b2eb-b8ae318b2bb7 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: c0f42aa4-6873-4be0-8a22-139180fa0061] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:27:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-97b7a4cd-2e16-4f0f-b2eb-b8ae318b2bb7 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-97b7a4cd-2e16-4f0f-b2eb-b8ae318b2bb7 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-97b7a4cd-2e16-4f0f-b2eb-b8ae318b2bb7 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-97b7a4cd-2e16-4f0f-b2eb-b8ae318b2bb7 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-97b7a4cd-2e16-4f0f-b2eb-b8ae318b2bb7 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:00 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-97b7a4cd-2e16-4f0f-b2eb-b8ae318b2bb7 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:00 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-97b7a4cd-2e16-4f0f-b2eb-b8ae318b2bb7 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:27:00 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-97b7a4cd-2e16-4f0f-b2eb-b8ae318b2bb7 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061" status: 200 len: 1543 microversion: 2.1 time: 0.236987 Apr 20 15:27:00 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 145/436] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:27:00 2023] GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061 => generated 1543 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:27:00 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-d329e02e-99e1-4da5-aeef-65eec0503102 req-2ed8e0a8-182c-4072-9211-01629b6e4671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f42aa4-6873-4be0-8a22-139180fa0061", "name": "network-vif-unplugged", "status": "completed", "tag": "6a572ad2-b3ff-42d0-91e5-b7f03df5da2f"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:27:00 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-d329e02e-99e1-4da5-aeef-65eec0503102 req-2ed8e0a8-182c-4072-9211-01629b6e4671 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:00 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-d329e02e-99e1-4da5-aeef-65eec0503102 req-2ed8e0a8-182c-4072-9211-01629b6e4671 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:00 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-d329e02e-99e1-4da5-aeef-65eec0503102 req-2ed8e0a8-182c-4072-9211-01629b6e4671 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:00 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-d329e02e-99e1-4da5-aeef-65eec0503102 req-2ed8e0a8-182c-4072-9211-01629b6e4671 service nova] Creating event network-vif-unplugged:6a572ad2-b3ff-42d0-91e5-b7f03df5da2f for instance c0f42aa4-6873-4be0-8a22-139180fa0061 on user Apr 20 15:27:00 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-d329e02e-99e1-4da5-aeef-65eec0503102 req-2ed8e0a8-182c-4072-9211-01629b6e4671 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028342 Apr 20 15:27:00 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 147/437] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:27:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:27:01 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-d36d29d8-35c8-40a4-903d-f40fc7b46491 req-dd5376a3-bc78-4d11-a369-e5a842d0f2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f42aa4-6873-4be0-8a22-139180fa0061", "name": "network-vif-deleted", "tag": "6a572ad2-b3ff-42d0-91e5-b7f03df5da2f"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:27:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d36d29d8-35c8-40a4-903d-f40fc7b46491 req-dd5376a3-bc78-4d11-a369-e5a842d0f2f9 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d36d29d8-35c8-40a4-903d-f40fc7b46491 req-dd5376a3-bc78-4d11-a369-e5a842d0f2f9 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d36d29d8-35c8-40a4-903d-f40fc7b46491 req-dd5376a3-bc78-4d11-a369-e5a842d0f2f9 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:01 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-d36d29d8-35c8-40a4-903d-f40fc7b46491 req-dd5376a3-bc78-4d11-a369-e5a842d0f2f9 service nova] Creating event network-vif-deleted:6a572ad2-b3ff-42d0-91e5-b7f03df5da2f for instance c0f42aa4-6873-4be0-8a22-139180fa0061 on user Apr 20 15:27:01 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-d36d29d8-35c8-40a4-903d-f40fc7b46491 req-dd5376a3-bc78-4d11-a369-e5a842d0f2f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089159 Apr 20 15:27:01 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 146/438] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:27:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:27:02 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-91b79410-5799-400b-bbcf-c449c8917e25 req-f08374d0-5b82-4482-8700-049f81a950bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f42aa4-6873-4be0-8a22-139180fa0061", "name": "network-vif-plugged", "status": "completed", "tag": "6a572ad2-b3ff-42d0-91e5-b7f03df5da2f"}, {"server_uuid": "c0f42aa4-6873-4be0-8a22-139180fa0061", "name": "network-vif-plugged", "status": "completed", "tag": "6a572ad2-b3ff-42d0-91e5-b7f03df5da2f"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:27:02 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-91b79410-5799-400b-bbcf-c449c8917e25 req-f08374d0-5b82-4482-8700-049f81a950bd service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:02 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-91b79410-5799-400b-bbcf-c449c8917e25 req-f08374d0-5b82-4482-8700-049f81a950bd service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:02 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-91b79410-5799-400b-bbcf-c449c8917e25 req-f08374d0-5b82-4482-8700-049f81a950bd service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:02 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-91b79410-5799-400b-bbcf-c449c8917e25 req-f08374d0-5b82-4482-8700-049f81a950bd service nova] Creating event network-vif-plugged:6a572ad2-b3ff-42d0-91e5-b7f03df5da2f for instance c0f42aa4-6873-4be0-8a22-139180fa0061 on user Apr 20 15:27:02 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-91b79410-5799-400b-bbcf-c449c8917e25 req-f08374d0-5b82-4482-8700-049f81a950bd service nova] Creating event network-vif-plugged:6a572ad2-b3ff-42d0-91e5-b7f03df5da2f for instance c0f42aa4-6873-4be0-8a22-139180fa0061 on user Apr 20 15:27:02 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-91b79410-5799-400b-bbcf-c449c8917e25 req-f08374d0-5b82-4482-8700-049f81a950bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033577 Apr 20 15:27:02 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 146/439] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:27:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=4 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=8 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: c0f42aa4-6873-4be0-8a22-139180fa0061] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:50 user devstack@n-api.service[61508]: INFO nova.api.openstack.wsgi [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] HTTP exception thrown: Instance c0f42aa4-6873-4be0-8a22-139180fa0061 could not be found. Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Request method failure captured: Apr 20 15:27:50 user devstack@n-api.service[61508]: request: GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061 HTTP/1.1 Apr 20 15:27:50 user devstack@n-api.service[61508]: Accept: application/json Apr 20 15:27:50 user devstack@n-api.service[61508]: Accept-Encoding: identity Apr 20 15:27:50 user devstack@n-api.service[61508]: Connection: close Apr 20 15:27:50 user devstack@n-api.service[61508]: Content-Length: 0 Apr 20 15:27:50 user devstack@n-api.service[61508]: Content-Type: application/json Apr 20 15:27:50 user devstack@n-api.service[61508]: Host: 10.0.0.210 Apr 20 15:27:50 user devstack@n-api.service[61508]: Openstack-System-Scope: None Apr 20 15:27:50 user devstack@n-api.service[61508]: User-Agent: python-urllib3/1.26.15 Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Auth-Token: gAAAAABkQVlKhbGcr88Ry3lBS9Ydut1H3Ledu7xxQjPNKM93mY1ucZKsOSrap2ke1vvi8RnlNwHpuTClfF8jOLdOudbeLsnexVaOqrhKlSvRVxk26PSJMSn5IjpiR88WzqKVOsX3XNhwkLGwMzbdOFHrollrUPfo1n7GBUF3_fIlK2pOZDMXcX8 Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Domain-Id: None Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Domain-Name: None Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Identity-Status: Confirmed Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Is-Admin-Project: True Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Project-Domain-Id: default Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Project-Domain-Name: Default Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Project-Id: e915a3fd15f94d6e960eb0d61d87914c Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Project-Name: tempest-TestMinimumBasicScenario-468849165 Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Role: member,reader Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Roles: member,reader Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e915a3fd15f94d6e960eb0d61d87914c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e915a3fd15f94d6e960eb0d61d87914c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e915a3fd15f94d6e960eb0d61d87914c"}]}] Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Tenant: tempest-TestMinimumBasicScenario-468849165 Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Tenant-Id: e915a3fd15f94d6e960eb0d61d87914c Apr 20 15:27:50 user devstack@n-api.service[61508]: X-Tenant-Name: tempest-TestMinimumBasicScenario-468849165 Apr 20 15:27:50 user devstack@n-api.service[61508]: X-User: tempest-TestMinimumBasicScenario-468849165-project-member Apr 20 15:27:50 user devstack@n-api.service[61508]: X-User-Domain-Id: default Apr 20 15:27:50 user devstack@n-api.service[61508]: X-User-Domain-Name: Default Apr 20 15:27:50 user devstack@n-api.service[61508]: X-User-Id: 9923613608ba4dccbefc5981204fc5b3 Apr 20 15:27:50 user devstack@n-api.service[61508]: X-User-Name: tempest-TestMinimumBasicScenario-468849165-project-member Apr 20 15:27:50 user devstack@n-api.service[61508]: method: > Apr 20 15:27:50 user devstack@n-api.service[61508]: exception: Instance c0f42aa4-6873-4be0-8a22-139180fa0061 could not be found. Apr 20 15:27:50 user devstack@n-api.service[61508]: action_args: {'id': 'c0f42aa4-6873-4be0-8a22-139180fa0061'} Apr 20 15:27:50 user devstack@n-api.service[61508]: {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f42aa4-6873-4be0-8a22-139180fa0061 could not be found. Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f42aa4-6873-4be0-8a22-139180fa0061 could not be found. Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f42aa4-6873-4be0-8a22-139180fa0061 could not be found. Apr 20 15:27:50 user devstack@n-api.service[61508]: ERROR nova.api.openstack.wsgi Apr 20 15:27:50 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Returning 404 to user: Instance c0f42aa4-6873-4be0-8a22-139180fa0061 could not be found. {{(pid=61508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:27:50 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-72f2c56c-6f6d-4340-a335-9b5f75f22270 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061" status: 404 len: 111 microversion: 2.1 time: 0.035695 Apr 20 15:27:50 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 148/440] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:27:50 2023] GET /compute/v2.1/servers/c0f42aa4-6873-4be0-8a22-139180fa0061 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:27:50 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:27:50 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:27:50 user devstack@n-api.service[61510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 15:27:50 user devstack@n-api.service[61510]: Thu Apr 20 15:27:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2032337917 (ip 10.0.0.210) !!! Apr 20 15:27:50 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-e0f353a0-52a9-4292-9f10-b913d7a06e0b tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '.version_select at 0x7fcbb369fac0>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:27:50 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-e0f353a0-52a9-4292-9f10-b913d7a06e0b tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2032337917" status: 202 len: 0 microversion: 2.1 time: 0.032265 Apr 20 15:27:50 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 147/441] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 20 15:27:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2032337917 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 15:27:52 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:27:52 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:27:52 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=16 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:27:52 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-10ae6017-db45-481d-8585-3789853803f0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Action: 'create', calling method: .version_select at 0x7fcbb36d0d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-542997920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhphdBAM1xts/MJu3azH8sFjBPsDMbeOp8oVE14NwfABNnLSF6UslVg1niM+v8Q8XLeWh1SprEJjctQrRTHmGzsqlwhXyEJFZdb90tMq1NuCL3u4sQ6bYV5muNxnoVP8w=="}} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:27:52 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-10ae6017-db45-481d-8585-3789853803f0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Getting quotas for project e915a3fd15f94d6e960eb0d61d87914c. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:27:52 user devstack@n-api.service[61509]: DEBUG nova.quota [None req-10ae6017-db45-481d-8585-3789853803f0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Getting quotas for user 9923613608ba4dccbefc5981204fc5b3 and project e915a3fd15f94d6e960eb0d61d87914c. Resources: {'key_pairs'} {{(pid=61509) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:27:53 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-10ae6017-db45-481d-8585-3789853803f0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062832 Apr 20 15:27:53 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 147/442] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 15:27:52 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2028827782", "imageRef": "aa21e36d-4d94-4947-ae42-888a249a9db9", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-542997920", "networks": [{"uuid": "360d0501-d79a-4ffb-be7e-ba247ac7c8f0"}]}} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.network.neutron [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] validate_networks() for [('360d0501-d79a-4ffb-be7e-ba247ac7c8f0', None, None, None, None, None)] {{(pid=61508) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Flavor limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Image limits 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Flavor pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Image pref 0:0:0 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.virt.hardware [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Getting quotas for project e915a3fd15f94d6e960eb0d61d87914c. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.quota [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Getting quotas for user 9923613608ba4dccbefc5981204fc5b3 and project e915a3fd15f94d6e960eb0d61d87914c. Resources: {'ram', 'instances', 'cores'} {{(pid=61508) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Going to run 1 instances... {{(pid=61508) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 15:27:53 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: 8f22bd09-1cf7-440d-9cf5-931a0a8abb77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa21e36d-4d94-4947-ae42-888a249a9db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 15:27:53 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-34e5a837-85a8-441b-9e4a-9ba4403d406a tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.772504 Apr 20 15:27:53 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 149/443] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 15:27:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 15:27:53 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-e071cd82-d409-4417-9578-6759902b37b6 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:27:53 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-e071cd82-d409-4417-9578-6759902b37b6 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: 8f22bd09-1cf7-440d-9cf5-931a0a8abb77] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:27:53 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-e071cd82-d409-4417-9578-6759902b37b6 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:27:53 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-e071cd82-d409-4417-9578-6759902b37b6 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77" status: 200 len: 1252 microversion: 2.1 time: 0.066421 Apr 20 15:27:53 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 148/444] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:27:53 2023] GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77 => generated 1252 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:27:56 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-46b71797-bff5-4449-837a-398fad37a2e7 req-2af48d99-b94c-470a-85ca-e3f662096edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f22bd09-1cf7-440d-9cf5-931a0a8abb77", "tag": "9375b34a-bfff-4aeb-ae14-bd951951fde0"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:27:56 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-46b71797-bff5-4449-837a-398fad37a2e7 req-2af48d99-b94c-470a-85ca-e3f662096edd service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:56 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-46b71797-bff5-4449-837a-398fad37a2e7 req-2af48d99-b94c-470a-85ca-e3f662096edd service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:56 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-46b71797-bff5-4449-837a-398fad37a2e7 req-2af48d99-b94c-470a-85ca-e3f662096edd service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:56 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-46b71797-bff5-4449-837a-398fad37a2e7 req-2af48d99-b94c-470a-85ca-e3f662096edd service nova] Creating event network-changed:9375b34a-bfff-4aeb-ae14-bd951951fde0 for instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 on user Apr 20 15:27:56 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-46b71797-bff5-4449-837a-398fad37a2e7 req-2af48d99-b94c-470a-85ca-e3f662096edd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031725 Apr 20 15:27:56 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 148/445] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:27:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:27:58 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-7ec143db-0eb7-4baf-b450-7cd2e1939c7a req-9e23246a-2aef-4580-89b3-3f430e1fde90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f22bd09-1cf7-440d-9cf5-931a0a8abb77", "name": "network-vif-plugged", "status": "completed", "tag": "9375b34a-bfff-4aeb-ae14-bd951951fde0"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:27:58 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-7ec143db-0eb7-4baf-b450-7cd2e1939c7a req-9e23246a-2aef-4580-89b3-3f430e1fde90 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:27:58 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-7ec143db-0eb7-4baf-b450-7cd2e1939c7a req-9e23246a-2aef-4580-89b3-3f430e1fde90 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:27:58 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-7ec143db-0eb7-4baf-b450-7cd2e1939c7a req-9e23246a-2aef-4580-89b3-3f430e1fde90 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:27:58 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-7ec143db-0eb7-4baf-b450-7cd2e1939c7a req-9e23246a-2aef-4580-89b3-3f430e1fde90 service nova] Creating event network-vif-plugged:9375b34a-bfff-4aeb-ae14-bd951951fde0 for instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 on user Apr 20 15:27:58 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-7ec143db-0eb7-4baf-b450-7cd2e1939c7a req-9e23246a-2aef-4580-89b3-3f430e1fde90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036771 Apr 20 15:27:58 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 150/446] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:27:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:28:00 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-e99d815a-825a-43c7-9dad-8a19add79bd0 req-8868198e-d0ad-4ba2-9471-5a35b56cb8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f22bd09-1cf7-440d-9cf5-931a0a8abb77", "name": "network-vif-plugged", "status": "completed", "tag": "9375b34a-bfff-4aeb-ae14-bd951951fde0"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:28:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e99d815a-825a-43c7-9dad-8a19add79bd0 req-8868198e-d0ad-4ba2-9471-5a35b56cb8cc service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:28:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e99d815a-825a-43c7-9dad-8a19add79bd0 req-8868198e-d0ad-4ba2-9471-5a35b56cb8cc service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:28:00 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e99d815a-825a-43c7-9dad-8a19add79bd0 req-8868198e-d0ad-4ba2-9471-5a35b56cb8cc service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:28:00 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-e99d815a-825a-43c7-9dad-8a19add79bd0 req-8868198e-d0ad-4ba2-9471-5a35b56cb8cc service nova] Creating event network-vif-plugged:9375b34a-bfff-4aeb-ae14-bd951951fde0 for instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 on user Apr 20 15:28:00 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-e99d815a-825a-43c7-9dad-8a19add79bd0 req-8868198e-d0ad-4ba2-9471-5a35b56cb8cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026784 Apr 20 15:28:00 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 149/447] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:28:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell0:SELECT=4 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-28bf5a48-f083-4451-9ba1-a1f1d64b24b8 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-28bf5a48-f083-4451-9ba1-a1f1d64b24b8 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: 8f22bd09-1cf7-440d-9cf5-931a0a8abb77] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-28bf5a48-f083-4451-9ba1-a1f1d64b24b8 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-28bf5a48-f083-4451-9ba1-a1f1d64b24b8 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-28bf5a48-f083-4451-9ba1-a1f1d64b24b8 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-28bf5a48-f083-4451-9ba1-a1f1d64b24b8 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-28bf5a48-f083-4451-9ba1-a1f1d64b24b8 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-28bf5a48-f083-4451-9ba1-a1f1d64b24b8 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:28:44 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-28bf5a48-f083-4451-9ba1-a1f1d64b24b8 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:28:44 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-28bf5a48-f083-4451-9ba1-a1f1d64b24b8 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77" status: 200 len: 1537 microversion: 2.1 time: 0.234213 Apr 20 15:28:44 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 149/448] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:28:43 2023] GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77 => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=2 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell0:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:29:44 user devstack@n-api.service[61508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 15:29:44 user devstack@n-api.service[61508]: Thu Apr 20 15:29:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77 (ip 10.0.0.210) !!! Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=6 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-300f91c5-13d4-4e29-b04b-c7b9ca765056 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-300f91c5-13d4-4e29-b04b-c7b9ca765056 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: 8f22bd09-1cf7-440d-9cf5-931a0a8abb77] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-300f91c5-13d4-4e29-b04b-c7b9ca765056 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-300f91c5-13d4-4e29-b04b-c7b9ca765056 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-300f91c5-13d4-4e29-b04b-c7b9ca765056 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-300f91c5-13d4-4e29-b04b-c7b9ca765056 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-300f91c5-13d4-4e29-b04b-c7b9ca765056 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-300f91c5-13d4-4e29-b04b-c7b9ca765056 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:44 user devstack@n-api.service[61508]: DEBUG nova.policy [None req-300f91c5-13d4-4e29-b04b-c7b9ca765056 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61508) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:29:44 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-300f91c5-13d4-4e29-b04b-c7b9ca765056 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77" status: 200 len: 1537 microversion: 2.1 time: 0.305149 Apr 20 15:29:44 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 151/449] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:29:44 2023] GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77 => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Searching by: {'deleted': False, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c'} {{(pid=61510) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:44 user devstack@n-api.service[61510]: DEBUG nova.compute.multi_cell_list [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61510) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 15:29:44 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-93b00802-f62a-420e-9610-7424a58abde0 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.276471 Apr 20 15:29:44 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 150/450] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 15:29:44 2023] GET /compute/v2.1/servers => generated 341 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:29:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_api:SELECT=2 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:29:44 user devstack@n-api.service[61509]: DEBUG dbcounter [-] [61509] Writing DB stats nova_cell1:SELECT=6 {{(pid=61509) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:29:44 user devstack@n-api.service[61509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 15:29:44 user devstack@n-api.service[61509]: Thu Apr 20 15:29:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77 (ip 10.0.0.210) !!! Apr 20 15:29:44 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [None req-46480118-54a4-4588-90d3-47d01cf168a4 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:29:44 user devstack@n-api.service[61509]: DEBUG nova.compute.api [None req-46480118-54a4-4588-90d3-47d01cf168a4 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: 8f22bd09-1cf7-440d-9cf5-931a0a8abb77] Fetching instance by UUID {{(pid=61509) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:29:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-46480118-54a4-4588-90d3-47d01cf168a4 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-46480118-54a4-4588-90d3-47d01cf168a4 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-46480118-54a4-4588-90d3-47d01cf168a4 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-46480118-54a4-4588-90d3-47d01cf168a4 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-46480118-54a4-4588-90d3-47d01cf168a4 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:44 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [None req-46480118-54a4-4588-90d3-47d01cf168a4 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:45 user devstack@n-api.service[61509]: DEBUG nova.policy [None req-46480118-54a4-4588-90d3-47d01cf168a4 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61509) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:29:45 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [None req-46480118-54a4-4588-90d3-47d01cf168a4 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77" status: 200 len: 1537 microversion: 2.1 time: 0.179410 Apr 20 15:29:45 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:29:44 2023] GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77 => generated 1537 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 15:29:46 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-50915b88-e641-42b3-a65e-343c3af97356 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:29:46 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-50915b88-e641-42b3-a65e-343c3af97356 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: 8f22bd09-1cf7-440d-9cf5-931a0a8abb77] Fetching instance by UUID {{(pid=61508) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:29:46 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-50915b88-e641-42b3-a65e-343c3af97356 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:46 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-50915b88-e641-42b3-a65e-343c3af97356 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:46 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-50915b88-e641-42b3-a65e-343c3af97356 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:46 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-50915b88-e641-42b3-a65e-343c3af97356 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:46 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-50915b88-e641-42b3-a65e-343c3af97356 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:46 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [None req-50915b88-e641-42b3-a65e-343c3af97356 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:46 user devstack@n-api.service[61508]: DEBUG nova.compute.api [None req-50915b88-e641-42b3-a65e-343c3af97356 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: 8f22bd09-1cf7-440d-9cf5-931a0a8abb77] Going to try to terminate instance {{(pid=61508) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 15:29:46 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-50915b88-e641-42b3-a65e-343c3af97356 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77" status: 204 len: 0 microversion: 2.1 time: 0.115870 Apr 20 15:29:46 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 152/452] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 15:29:46 2023] DELETE /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 15:29:46 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c6d2b800-f272-4b10-b5e8-da3f437d8835 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:29:46 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c6d2b800-f272-4b10-b5e8-da3f437d8835 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: 8f22bd09-1cf7-440d-9cf5-931a0a8abb77] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:29:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c6d2b800-f272-4b10-b5e8-da3f437d8835 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c6d2b800-f272-4b10-b5e8-da3f437d8835 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c6d2b800-f272-4b10-b5e8-da3f437d8835 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c6d2b800-f272-4b10-b5e8-da3f437d8835 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c6d2b800-f272-4b10-b5e8-da3f437d8835 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c6d2b800-f272-4b10-b5e8-da3f437d8835 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:46 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-8f6ca408-096d-406c-8a7f-51c2d414b8fb req-7af80679-534f-4b61-8033-b4619e6ed41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f22bd09-1cf7-440d-9cf5-931a0a8abb77", "name": "network-vif-unplugged", "status": "completed", "tag": "9375b34a-bfff-4aeb-ae14-bd951951fde0"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:29:46 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-8f6ca408-096d-406c-8a7f-51c2d414b8fb req-7af80679-534f-4b61-8033-b4619e6ed41d service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:46 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-8f6ca408-096d-406c-8a7f-51c2d414b8fb req-7af80679-534f-4b61-8033-b4619e6ed41d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:46 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-8f6ca408-096d-406c-8a7f-51c2d414b8fb req-7af80679-534f-4b61-8033-b4619e6ed41d service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:46 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-8f6ca408-096d-406c-8a7f-51c2d414b8fb req-7af80679-534f-4b61-8033-b4619e6ed41d service nova] Creating event network-vif-unplugged:9375b34a-bfff-4aeb-ae14-bd951951fde0 for instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 on user Apr 20 15:29:46 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-8f6ca408-096d-406c-8a7f-51c2d414b8fb req-7af80679-534f-4b61-8033-b4619e6ed41d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034951 Apr 20 15:29:46 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 151/453] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:29:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:29:46 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-c6d2b800-f272-4b10-b5e8-da3f437d8835 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9923613608ba4dccbefc5981204fc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e915a3fd15f94d6e960eb0d61d87914c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 15:29:47 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c6d2b800-f272-4b10-b5e8-da3f437d8835 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77" status: 200 len: 1543 microversion: 2.1 time: 0.327150 Apr 20 15:29:47 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 151/454] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:29:46 2023] GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77 => generated 1543 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:29:47 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [req-67d12b68-4e3e-40c1-bfc8-7a06e853f88d req-674824d3-dce1-4fce-b8ff-2aa67f46639e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f22bd09-1cf7-440d-9cf5-931a0a8abb77", "name": "network-vif-deleted", "tag": "9375b34a-bfff-4aeb-ae14-bd951951fde0"}]} {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:29:47 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-67d12b68-4e3e-40c1-bfc8-7a06e853f88d req-674824d3-dce1-4fce-b8ff-2aa67f46639e service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:47 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-67d12b68-4e3e-40c1-bfc8-7a06e853f88d req-674824d3-dce1-4fce-b8ff-2aa67f46639e service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:47 user devstack@n-api.service[61508]: DEBUG oslo_concurrency.lockutils [req-67d12b68-4e3e-40c1-bfc8-7a06e853f88d req-674824d3-dce1-4fce-b8ff-2aa67f46639e service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61508) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:47 user devstack@n-api.service[61508]: INFO nova.api.openstack.compute.server_external_events [req-67d12b68-4e3e-40c1-bfc8-7a06e853f88d req-674824d3-dce1-4fce-b8ff-2aa67f46639e service nova] Creating event network-vif-deleted:9375b34a-bfff-4aeb-ae14-bd951951fde0 for instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 on user Apr 20 15:29:47 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [req-67d12b68-4e3e-40c1-bfc8-7a06e853f88d req-674824d3-dce1-4fce-b8ff-2aa67f46639e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029047 Apr 20 15:29:47 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 153/455] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:29:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:29:48 user devstack@n-api.service[61509]: DEBUG nova.api.openstack.wsgi [req-42ae5268-7449-4b58-8c40-6e461b291c37 req-96c49e31-802a-474d-9a9e-cc8df5eeca29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f22bd09-1cf7-440d-9cf5-931a0a8abb77", "name": "network-vif-plugged", "status": "completed", "tag": "9375b34a-bfff-4aeb-ae14-bd951951fde0"}]} {{(pid=61509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:29:48 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-42ae5268-7449-4b58-8c40-6e461b291c37 req-96c49e31-802a-474d-9a9e-cc8df5eeca29 service nova] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:29:48 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-42ae5268-7449-4b58-8c40-6e461b291c37 req-96c49e31-802a-474d-9a9e-cc8df5eeca29 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:29:48 user devstack@n-api.service[61509]: DEBUG oslo_concurrency.lockutils [req-42ae5268-7449-4b58-8c40-6e461b291c37 req-96c49e31-802a-474d-9a9e-cc8df5eeca29 service nova] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:29:49 user devstack@n-api.service[61509]: INFO nova.api.openstack.compute.server_external_events [req-42ae5268-7449-4b58-8c40-6e461b291c37 req-96c49e31-802a-474d-9a9e-cc8df5eeca29 service nova] Creating event network-vif-plugged:9375b34a-bfff-4aeb-ae14-bd951951fde0 for instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 on user Apr 20 15:29:49 user devstack@n-api.service[61509]: INFO nova.api.openstack.requestlog [req-42ae5268-7449-4b58-8c40-6e461b291c37 req-96c49e31-802a-474d-9a9e-cc8df5eeca29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028871 Apr 20 15:29:49 user devstack@n-api.service[61509]: [pid: 61509|app: 0|req: 152/456] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 15:29:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=14 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] [instance: 8f22bd09-1cf7-440d-9cf5-931a0a8abb77] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Acquiring lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Lock "c9259cc4-6390-40ae-86fb-bec94ff13c9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:30:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] HTTP exception thrown: Instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 could not be found. Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Request method failure captured: Apr 20 15:30:37 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77 HTTP/1.1 Apr 20 15:30:37 user devstack@n-api.service[61510]: Accept: application/json Apr 20 15:30:37 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 20 15:30:37 user devstack@n-api.service[61510]: Connection: close Apr 20 15:30:37 user devstack@n-api.service[61510]: Content-Length: 0 Apr 20 15:30:37 user devstack@n-api.service[61510]: Content-Type: application/json Apr 20 15:30:37 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 20 15:30:37 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 20 15:30:37 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQVlKhbGcr88Ry3lBS9Ydut1H3Ledu7xxQjPNKM93mY1ucZKsOSrap2ke1vvi8RnlNwHpuTClfF8jOLdOudbeLsnexVaOqrhKlSvRVxk26PSJMSn5IjpiR88WzqKVOsX3XNhwkLGwMzbdOFHrollrUPfo1n7GBUF3_fIlK2pOZDMXcX8 Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Project-Id: e915a3fd15f94d6e960eb0d61d87914c Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Project-Name: tempest-TestMinimumBasicScenario-468849165 Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Role: member,reader Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Roles: member,reader Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e915a3fd15f94d6e960eb0d61d87914c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e915a3fd15f94d6e960eb0d61d87914c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e915a3fd15f94d6e960eb0d61d87914c"}]}] Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Tenant: tempest-TestMinimumBasicScenario-468849165 Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Tenant-Id: e915a3fd15f94d6e960eb0d61d87914c Apr 20 15:30:37 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-TestMinimumBasicScenario-468849165 Apr 20 15:30:37 user devstack@n-api.service[61510]: X-User: tempest-TestMinimumBasicScenario-468849165-project-member Apr 20 15:30:37 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 20 15:30:37 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 20 15:30:37 user devstack@n-api.service[61510]: X-User-Id: 9923613608ba4dccbefc5981204fc5b3 Apr 20 15:30:37 user devstack@n-api.service[61510]: X-User-Name: tempest-TestMinimumBasicScenario-468849165-project-member Apr 20 15:30:37 user devstack@n-api.service[61510]: method: > Apr 20 15:30:37 user devstack@n-api.service[61510]: exception: Instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 could not be found. Apr 20 15:30:37 user devstack@n-api.service[61510]: action_args: {'id': '8f22bd09-1cf7-440d-9cf5-931a0a8abb77'} Apr 20 15:30:37 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 could not be found. Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 could not be found. Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 could not be found. Apr 20 15:30:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 20 15:30:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Returning 404 to user: Instance 8f22bd09-1cf7-440d-9cf5-931a0a8abb77 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 15:30:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-66ef0c3d-338a-4be3-a4ec-68a5570e98a2 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77" status: 404 len: 111 microversion: 2.1 time: 0.130448 Apr 20 15:30:37 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 152/457] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 15:30:37 2023] GET /compute/v2.1/servers/8f22bd09-1cf7-440d-9cf5-931a0a8abb77 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 15:30:37 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:30:37 user devstack@n-api.service[61508]: DEBUG dbcounter [-] [61508] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61508) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:30:37 user devstack@n-api.service[61508]: DEBUG nova.api.openstack.wsgi [None req-9be2d95b-79e6-4a19-b63e-4f49f5067c95 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] Calling method '.version_select at 0x7fcbb3611870>' {{(pid=61508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:30:37 user devstack@n-api.service[61508]: INFO nova.api.openstack.requestlog [None req-9be2d95b-79e6-4a19-b63e-4f49f5067c95 tempest-TestMinimumBasicScenario-468849165 tempest-TestMinimumBasicScenario-468849165-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-542997920" status: 202 len: 0 microversion: 2.1 time: 0.032268 Apr 20 15:30:37 user devstack@n-api.service[61508]: [pid: 61508|app: 0|req: 154/458] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 20 15:30:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-542997920 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)